Nov 30 09:09:28 user nova-compute[75340]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75340) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 09:09:28 user nova-compute[75340]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75340) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 09:09:28 user nova-compute[75340]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75340) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 09:09:28 user nova-compute[75340]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 30 09:09:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:09:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:09:28 user nova-compute[75340]: INFO nova.virt.driver [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 30 09:09:29 user nova-compute[75340]: INFO nova.compute.provider_config [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Acquiring lock "singleton_lock" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Acquired lock "singleton_lock" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Releasing lock "singleton_lock" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Full set of CONF: {{(pid=75340) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ******************************************************************************** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Configuration options gathered from: {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ================================================================================ {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] allow_resize_to_same_host      = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] arq_binding_timeout            = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] backdoor_port                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] backdoor_socket                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] block_device_allocate_retries  = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] block_device_allocate_retries_interval = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cert                           = self.pem {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute_monitors               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] config_dir                     = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] config_drive_format            = iso9660 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] config_source                  = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] console_host                   = user {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] control_exchange               = nova {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cpu_allocation_ratio           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] daemon                         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] debug                          = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_access_ip_network_name = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_availability_zone      = nova {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_ephemeral_format       = ext4 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_green_pool_size        = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] default_schedule_zone          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] disk_allocation_ratio          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] enable_new_services            = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] enabled_apis                   = ['osapi_compute'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] enabled_ssl_apis               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] flat_injected                  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] force_config_drive             = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] force_raw_images               = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] graceful_shutdown_timeout      = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] heal_instance_info_cache_interval = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] host                           = user {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_build_timeout         = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_delete_interval       = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_format                = [instance: %(uuid)s]  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_name_template         = instance-%08x {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_usage_audit           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_usage_audit_period    = month {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] internal_service_availability_zone = internal {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] key                            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] live_migration_retry_count     = 30 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_config_append              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_dir                        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_file                       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_options                    = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_rotate_interval            = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_rotate_interval_type       = days {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] log_rotation_type              = none {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] long_rpc_timeout               = 1800 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_concurrent_builds          = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_concurrent_live_migrations = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_concurrent_snapshots       = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_local_block_devices        = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_logfile_count              = 30 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] max_logfile_size_mb            = 200 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] maximum_instance_delete_attempts = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metadata_listen                = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metadata_listen_port           = 8775 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metadata_workers               = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] migrate_max_retries            = -1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] mkisofs_cmd                    = genisoimage {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] my_ip                          = 10.0.0.210 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] network_allocate_retries       = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] osapi_compute_listen_port      = 8774 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] osapi_compute_unique_server_name_scope =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] osapi_compute_workers          = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] password_length                = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] periodic_enable                = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] periodic_fuzzy_delay           = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] pointer_model                  = ps2mouse {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] preallocate_images             = none {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] publish_errors                 = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] pybasedir                      = /opt/stack/nova {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ram_allocation_ratio           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rate_limit_burst               = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rate_limit_except_level        = CRITICAL {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rate_limit_interval            = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reboot_timeout                 = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reclaim_instance_interval      = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] record                         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reimage_timeout_per_gb         = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] report_interval                = 120 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rescue_timeout                 = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reserved_host_cpus             = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reserved_host_disk_mb          = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reserved_host_memory_mb        = 512 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] reserved_huge_pages            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] resize_confirm_window          = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] resize_fs_using_block_device   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] resume_guests_state_on_host_boot = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rpc_response_timeout           = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] run_external_periodic_tasks    = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] running_deleted_instance_action = reap {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] running_deleted_instance_poll_interval = 1800 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] running_deleted_instance_timeout = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler_instance_sync_interval = 120 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_down_time              = 720 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] servicegroup_driver            = db {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] shelved_offload_time           = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] shelved_poll_interval          = 3600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] shutdown_timeout               = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] source_is_ipv6                 = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ssl_only                       = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] state_path                     = /opt/stack/data/nova {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] sync_power_state_interval      = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] sync_power_state_pool_size     = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] syslog_log_facility            = LOG_USER {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] tempdir                        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] timeout_nbd                    = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] transport_url                  = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] update_resources_interval      = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_cow_images                 = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_eventlog                   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_journal                    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_json                       = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_rootwrap_daemon            = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_stderr                     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] use_syslog                     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vcpu_pin_set                   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plugging_is_fatal          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plugging_timeout           = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] virt_mkfs                      = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] volume_usage_poll_interval     = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] watch_log_file                 = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] web                            = /usr/share/spice-html5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_concurrency.disable_process_locking = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.auth_strategy              = keystone {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.compute_link_prefix        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.dhcp_domain                = novalocal {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.enable_instance_password   = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.glance_link_prefix         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.instance_list_per_project_cells = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.list_records_by_skipping_down_cells = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.local_metadata_per_cell    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.max_limit                  = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.metadata_cache_expiration  = 15 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.neutron_default_tenant_id  = default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.use_forwarded_for          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.use_neutron_default_nets   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_dynamic_targets = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_jsonfile_path   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.backend                  = dogpile.cache.memcached {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.backend_argument         = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.config_prefix            = cache.oslo {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.dead_timeout             = 60.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.debug_cache_backend      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.enable_retry_client      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.enable_socket_keepalive  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.enabled                  = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.expiration_time          = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.hashclient_retry_attempts = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_dead_retry      = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_password        =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_pool_maxsize    = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_sasl_enabled    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.memcache_username        =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.proxies                  = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.retry_attempts           = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.retry_delay              = 0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.socket_keepalive_count   = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.socket_keepalive_idle    = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.socket_keepalive_interval = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.tls_allowed_ciphers      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.tls_cafile               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.tls_certfile             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.tls_enabled              = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cache.tls_keyfile              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.auth_section            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.auth_type               = password {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.cafile                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.certfile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.collect_timing          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.cross_az_attach         = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.debug                   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.endpoint_template       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.http_retries            = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.insecure                = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.keyfile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.os_region_name          = RegionOne {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.split_loggers           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cinder.timeout                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.cpu_dedicated_set      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.cpu_shared_set         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.image_type_exclude_list = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.max_concurrent_disk_ops = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.max_disk_devices_to_attach = -1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.resource_provider_association_refresh = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.shutdown_retry_interval = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] conductor.workers              = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] console.allowed_origins        = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] console.ssl_ciphers            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] console.ssl_minimum_version    = default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] consoleauth.token_ttl          = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.cafile                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.certfile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.collect_timing          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.connect_retries         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.connect_retry_delay     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.endpoint_override       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.insecure                = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.keyfile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.max_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.min_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.region_name             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.service_name            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.service_type            = accelerator {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.split_loggers           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.status_code_retries     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.timeout                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] cyborg.version                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.backend               = sqlalchemy {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.connection            = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.connection_debug      = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.connection_parameters =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.connection_recycle_time = 3600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.connection_trace      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.db_inc_retry_interval = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.db_max_retries        = 20 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.db_max_retry_interval = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.db_retry_interval     = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.max_overflow          = 50 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.max_pool_size         = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.max_retries           = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.mysql_wsrep_sync_wait = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.pool_timeout          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.retry_interval        = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.slave_connection      = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] database.sqlite_synchronous    = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.backend           = sqlalchemy {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.connection        = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.connection_debug  = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.connection_parameters =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.connection_recycle_time = 3600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.connection_trace  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.db_inc_retry_interval = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.db_max_retries    = 20 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.db_max_retry_interval = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.db_retry_interval = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.max_overflow      = 50 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.max_pool_size     = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.max_retries       = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.pool_timeout      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.retry_interval    = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.slave_connection  = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] api_database.sqlite_synchronous = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] devices.enabled_mdev_types     = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ephemeral_storage_encryption.enabled = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.api_servers             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.cafile                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.certfile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.collect_timing          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.connect_retries         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.connect_retry_delay     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.debug                   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.default_trusted_certificate_ids = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.enable_certificate_validation = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.enable_rbd_download     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.endpoint_override       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.insecure                = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.keyfile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.max_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.min_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.num_retries             = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.rbd_ceph_conf           =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.rbd_connect_timeout     = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.rbd_pool                =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.rbd_user                =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.region_name             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.service_name            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.service_type            = image {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.split_loggers           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.status_code_retries     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.timeout                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.verify_glance_signatures = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] glance.version                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] guestfs.debug                  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.config_drive_cdrom      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.config_drive_inject_password = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.enable_instance_metrics_collection = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.enable_remotefx         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.instances_path_share    =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.iscsi_initiator_list    = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.limit_cpu_features      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.power_state_check_timeframe = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.use_multipath_io        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.volume_attach_retry_count = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.vswitch_name            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] mks.enabled                    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.manager_interval   = 2400 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.precache_concurrency = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.remove_unused_base_images = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] image_cache.subdirectory_name  = _base {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.api_max_retries         = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.api_retry_interval      = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.auth_section            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.auth_type               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.cafile                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.certfile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.collect_timing          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.conductor_group         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.connect_retries         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.connect_retry_delay     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.endpoint_override       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.insecure                = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.keyfile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.max_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.min_version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.peer_list               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.region_name             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.serial_console_state_timeout = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.service_name            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.service_type            = baremetal {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.split_loggers           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.status_code_retries     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.timeout                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ironic.version                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] key_manager.fixed_key          = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.barbican_api_version  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.barbican_endpoint     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.barbican_endpoint_type = public {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.barbican_region_name  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.cafile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.certfile              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.collect_timing        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.insecure              = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.keyfile               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.number_of_retries     = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.retry_delay           = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.send_service_user_token = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.split_loggers         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.timeout               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.verify_ssl            = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican.verify_ssl_path       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.auth_section = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.auth_type = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.cafile   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.certfile = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.collect_timing = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.insecure = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.keyfile  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.split_loggers = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] barbican_service_user.timeout  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.approle_role_id          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.approle_secret_id        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.cafile                   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.certfile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.collect_timing           = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.insecure                 = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.keyfile                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.kv_mountpoint            = secret {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.kv_path                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.kv_version               = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.namespace                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.root_token_id            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.split_loggers            = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.ssl_ca_crt_file          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.timeout                  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.use_ssl                  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.auth_section          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.auth_type             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.cafile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.certfile              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.collect_timing        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.connect_retries       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.connect_retry_delay   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.endpoint_override     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.insecure              = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.keyfile               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.max_version           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.min_version           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.region_name           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.service_name          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.service_type          = identity {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.split_loggers         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.status_code_retries   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.timeout               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] keystone.version               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.connection_uri         =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_mode               = custom {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: WARNING oslo_config.cfg [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_power_governor_high = performance {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_power_governor_low = powersave {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_power_management   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.device_detach_attempts = 8 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.device_detach_timeout  = 20 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.disk_cachemodes        = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.disk_prefix            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.enabled_perf_events    = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.file_backed_memory     = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.gid_maps               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.hw_disk_discard        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.hw_machine_type        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_rbd_glance_store_name =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_rbd_pool        = rbd {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_type            = default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.images_volume_group    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.inject_key             = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.inject_partition       = -2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.inject_password        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.iscsi_iface            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.iser_use_multipath     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_bandwidth = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_downtime = 500 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_inbound_addr = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_permit_post_copy = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_scheme  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_timeout_action = abort {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_tunnelled = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: WARNING oslo_config.cfg [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 30 09:09:29 user nova-compute[75340]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 30 09:09:29 user nova-compute[75340]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 30 09:09:29 user nova-compute[75340]: and ``live_migration_inbound_addr`` respectively.
Nov 30 09:09:29 user nova-compute[75340]: ).  Its value may be silently ignored in the future.
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.live_migration_with_native_tls = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.max_queues             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.nfs_mount_options      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_memory_encrypted_guests = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_pcie_ports         = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.pmem_namespaces        = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.quobyte_client_cfg     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rbd_secret_uuid        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rbd_user               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.remote_filesystem_transport = ssh {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rescue_image_id        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rescue_kernel_id       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rescue_ramdisk_id      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.rx_queue_size          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.smbfs_mount_options    =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.snapshot_compression   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.snapshot_image_format  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.sparse_logical_volumes = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.swtpm_enabled          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.swtpm_group            = tss {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.swtpm_user             = tss {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.sysinfo_serial         = unique {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.tb_cache_size          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.tx_queue_size          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.uid_maps               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.use_virtio_for_bridges = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.virt_type              = kvm {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.volume_clear           = zero {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.volume_clear_size      = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.volume_use_multipath   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_cache_path   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.vzstorage_mount_user   = stack {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.auth_section           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.auth_type              = password {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.cafile                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.certfile               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.collect_timing         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.connect_retries        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.connect_retry_delay    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.default_floating_pool  = public {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.endpoint_override      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.extension_sync_interval = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.http_retries           = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.insecure               = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.keyfile                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.max_version            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.min_version            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.ovs_bridge             = br-int {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.physnets               = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.region_name            = RegionOne {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.service_metadata_proxy = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.service_name           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.service_type           = network {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.split_loggers          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.status_code_retries    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.timeout                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] neutron.version                = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] notifications.bdms_in_notifications = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] notifications.default_level    = INFO {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] notifications.notification_format = unversioned {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] notifications.notify_on_state_change = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] pci.alias                      = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] pci.device_spec                = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] pci.report_in_placement        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.auth_section         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.auth_type            = password {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.cafile               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.certfile             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.collect_timing       = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.connect_retries      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.connect_retry_delay  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.default_domain_id    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.default_domain_name  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.domain_id            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.domain_name          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.endpoint_override    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.insecure             = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.keyfile              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.max_version          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.min_version          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.password             = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.project_domain_id    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.project_domain_name  = Default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.project_id           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.project_name         = service {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.region_name          = RegionOne {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.service_name         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.service_type         = placement {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.split_loggers        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.status_code_retries  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.system_scope         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.timeout              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.trust_id             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.user_domain_id       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.user_domain_name     = Default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.user_id              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.username             = placement {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] placement.version              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.cores                    = 20 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.count_usage_from_placement = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.injected_file_content_bytes = 10240 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.injected_file_path_length = 255 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.injected_files           = 5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.instances                = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.key_pairs                = 100 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.metadata_items           = 128 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.ram                      = 51200 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.recheck_quota            = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.server_group_members     = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] quota.server_groups            = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rdp.enabled                    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.image_metadata_prefilter = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.max_attempts         = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.max_placement_results = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.query_placement_for_image_type_support = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] scheduler.workers              = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.host_subset_size = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.isolated_hosts = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.isolated_images = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.pci_in_placement = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.track_instance_changes = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metrics.required               = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metrics.weight_multiplier      = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] metrics.weight_setting         = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.enabled         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.port_range      = 10000:20000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] serial_console.serialproxy_port = 6083 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.auth_section      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.auth_type         = password {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.cafile            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.certfile          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.collect_timing    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.insecure          = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.keyfile           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.send_service_user_token = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.split_loggers     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] service_user.timeout           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.agent_enabled            = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.enabled                  = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.html5proxy_port          = 6082 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.image_compression        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.jpeg_compression         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.playback_compression     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.server_listen            = 127.0.0.1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.streaming_mode           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] spice.zlib_compression         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] upgrade_levels.baseapi         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] upgrade_levels.compute         = auto {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] upgrade_levels.conductor       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] upgrade_levels.scheduler       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.auth_section = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.auth_type = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.cafile = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.certfile = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.insecure = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.keyfile = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vendordata_dynamic_auth.timeout = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.api_retry_count         = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.ca_file                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.cache_prefix            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.cluster_name            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.connection_pool_size    = 10 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.console_delay_seconds   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.datastore_regex         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.host_ip                 = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.host_password           = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.host_port               = 443 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.host_username           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.insecure                = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.integration_bridge      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.maximum_objects         = 100 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.pbm_default_policy      = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.pbm_enabled             = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.pbm_wsdl_location       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.serial_port_proxy_uri   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.serial_port_service_uri = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.task_poll_interval      = 0.5 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.use_linked_clone        = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.vnc_keymap              = en-us {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.vnc_port                = 5900 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vmware.vnc_port_total          = 10000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.auth_schemes               = ['none'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.enabled                    = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.novncproxy_port            = 6080 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.server_listen              = 0.0.0.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.vencrypt_ca_certs          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.vencrypt_client_cert       = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vnc.vencrypt_client_key        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.disable_rootwrap   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.enable_numa_live_migration = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.libvirt_disable_apic = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.client_socket_timeout     = 900 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.default_pool_size         = 1000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.keep_alive                = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.max_header_line           = 16384 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.ssl_ca_file               = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.ssl_cert_file             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.ssl_key_file              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.tcp_keepidle              = 600 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] zvm.ca_file                    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] zvm.cloud_connector_url        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] zvm.reachable_timeout          = 300 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.enforce_new_defaults = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.enforce_scope      = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.policy_default_rule = default {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.policy_file        = policy.yaml {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.connection_string     = messaging:// {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.enabled               = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.es_doc_type           = notification {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.es_scroll_size        = 10000 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.es_scroll_time        = 2m {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.filter_error_trace    = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.hmac_keys             = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.sentinel_service_name = mymaster {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.socket_timeout        = 0.1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.trace_requests        = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler.trace_sqlalchemy      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler_jaeger.process_tags   = {} {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler_jaeger.service_name_prefix = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] profiler_otlp.service_name_prefix = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] remote_debug.host              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] remote_debug.port              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_notifications.retry = -1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_messaging_notifications.transport_url = **** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.auth_section        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.auth_type           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.cafile              = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.certfile            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.collect_timing      = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.connect_retries     = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.connect_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.endpoint_id         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.endpoint_override   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.insecure            = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.keyfile             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.max_version         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.min_version         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.region_name         = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.service_name        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.service_type        = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.split_loggers       = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.status_code_retries = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.status_code_retry_delay = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.timeout             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.valid_interfaces    = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_limit.version             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_reports.file_event_handler = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] oslo_reports.log_dir           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.group  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] vif_plug_ovs_privileged.user   = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.flat_interface = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.isolate_vif         = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_vif_ovs.per_port_bridge     = False {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] os_brick.lock_path             = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.capabilities   = [21] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.group          = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.helper_command = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] privsep_osbrick.user           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.group           = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.helper_command  = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] nova_sys_admin.user            = None {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG oslo_service.service [None req-a42bf3be-0fa8-4884-b95f-9877850071cf None None] ******************************************************************************** {{(pid=75340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 30 09:09:29 user nova-compute[75340]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Connecting to libvirt: qemu:///system {{(pid=75340) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7eff5110a470> {{(pid=75340) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 30 09:09:29 user nova-compute[75340]: libvirt:  error : internal error: could not initialize domain event timer
Nov 30 09:09:29 user nova-compute[75340]: WARNING nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7eff5110a470> {{(pid=75340) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Starting native event thread {{(pid=75340) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Starting green dispatch thread {{(pid=75340) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Starting connection event dispatch thread {{(pid=75340) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 30 09:09:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Connection event '1' reason 'None'
Nov 30 09:09:29 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 09:09:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.mount [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Initialising _HostMountState generation 0 {{(pid=75340) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 30 09:09:37 user nova-compute[75340]: INFO nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host capabilities <capabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <host>
Nov 30 09:09:37 user nova-compute[75340]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 30 09:09:37 user nova-compute[75340]:     <cpu>
Nov 30 09:09:37 user nova-compute[75340]:       <arch>x86_64</arch>
Nov 30 09:09:37 user nova-compute[75340]:       <model>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <microcode version='1070'/>
Nov 30 09:09:37 user nova-compute[75340]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='osxsave'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='invtsc'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='rsba'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature name='skip-l1dfl-vmentry'/>
Nov 30 09:09:37 user nova-compute[75340]:       <pages unit='KiB' size='4'/>
Nov 30 09:09:37 user nova-compute[75340]:       <pages unit='KiB' size='2048'/>
Nov 30 09:09:37 user nova-compute[75340]:     </cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <power_management>
Nov 30 09:09:37 user nova-compute[75340]:       <suspend_mem/>
Nov 30 09:09:37 user nova-compute[75340]:       <suspend_disk/>
Nov 30 09:09:37 user nova-compute[75340]:       <suspend_hybrid/>
Nov 30 09:09:37 user nova-compute[75340]:     </power_management>
Nov 30 09:09:37 user nova-compute[75340]:     <iommu support='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <migration_features>
Nov 30 09:09:37 user nova-compute[75340]:       <live/>
Nov 30 09:09:37 user nova-compute[75340]:       <uri_transports>
Nov 30 09:09:37 user nova-compute[75340]:         <uri_transport>tcp</uri_transport>
Nov 30 09:09:37 user nova-compute[75340]:         <uri_transport>rdma</uri_transport>
Nov 30 09:09:37 user nova-compute[75340]:       </uri_transports>
Nov 30 09:09:37 user nova-compute[75340]:     </migration_features>
Nov 30 09:09:37 user nova-compute[75340]:     <topology>
Nov 30 09:09:37 user nova-compute[75340]:       <cells num='2'>
Nov 30 09:09:37 user nova-compute[75340]:         <cell id='0'>
Nov 30 09:09:37 user nova-compute[75340]:           <memory unit='KiB'>8189224</memory>
Nov 30 09:09:37 user nova-compute[75340]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 30 09:09:37 user nova-compute[75340]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 09:09:37 user nova-compute[75340]:           <distances>
Nov 30 09:09:37 user nova-compute[75340]:             <sibling id='0' value='10'/>
Nov 30 09:09:37 user nova-compute[75340]:             <sibling id='1' value='20'/>
Nov 30 09:09:37 user nova-compute[75340]:           </distances>
Nov 30 09:09:37 user nova-compute[75340]:           <cpus num='6'>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 30 09:09:37 user nova-compute[75340]:           </cpus>
Nov 30 09:09:37 user nova-compute[75340]:         </cell>
Nov 30 09:09:37 user nova-compute[75340]:         <cell id='1'>
Nov 30 09:09:37 user nova-compute[75340]:           <memory unit='KiB'>8206460</memory>
Nov 30 09:09:37 user nova-compute[75340]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 30 09:09:37 user nova-compute[75340]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 09:09:37 user nova-compute[75340]:           <distances>
Nov 30 09:09:37 user nova-compute[75340]:             <sibling id='0' value='20'/>
Nov 30 09:09:37 user nova-compute[75340]:             <sibling id='1' value='10'/>
Nov 30 09:09:37 user nova-compute[75340]:           </distances>
Nov 30 09:09:37 user nova-compute[75340]:           <cpus num='6'>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 30 09:09:37 user nova-compute[75340]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 30 09:09:37 user nova-compute[75340]:           </cpus>
Nov 30 09:09:37 user nova-compute[75340]:         </cell>
Nov 30 09:09:37 user nova-compute[75340]:       </cells>
Nov 30 09:09:37 user nova-compute[75340]:     </topology>
Nov 30 09:09:37 user nova-compute[75340]:     <cache>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 30 09:09:37 user nova-compute[75340]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 30 09:09:37 user nova-compute[75340]:     </cache>
Nov 30 09:09:37 user nova-compute[75340]:     <secmodel>
Nov 30 09:09:37 user nova-compute[75340]:       <model>apparmor</model>
Nov 30 09:09:37 user nova-compute[75340]:       <doi>0</doi>
Nov 30 09:09:37 user nova-compute[75340]:     </secmodel>
Nov 30 09:09:37 user nova-compute[75340]:     <secmodel>
Nov 30 09:09:37 user nova-compute[75340]:       <model>dac</model>
Nov 30 09:09:37 user nova-compute[75340]:       <doi>0</doi>
Nov 30 09:09:37 user nova-compute[75340]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 30 09:09:37 user nova-compute[75340]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 30 09:09:37 user nova-compute[75340]:     </secmodel>
Nov 30 09:09:37 user nova-compute[75340]:   </host>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='alpha'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>clipper</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='armv6l'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>spitz</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>nuri</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>kzm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>z2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>tosa</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n810</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>terrier</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>midway</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>microbit</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>verdex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>highbank</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>akita</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>connex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>collie</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='armv7l'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>spitz</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>nuri</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>kzm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>z2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>tosa</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n810</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>terrier</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>midway</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>microbit</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>verdex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>highbank</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>akita</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>connex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>collie</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='aarch64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>spitz</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>nuri</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>kzm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>z2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>tosa</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n810</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>n800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>terrier</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>midway</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>microbit</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>verdex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>raspi3b</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>highbank</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>akita</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>connex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>collie</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <acpi default='on' toggle='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='cris'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='i686'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>isapc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>microvm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='kvm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <pae/>
Nov 30 09:09:37 user nova-compute[75340]:       <nonpae/>
Nov 30 09:09:37 user nova-compute[75340]:       <acpi default='on' toggle='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:       <apic default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='m68k'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>an5206</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>q800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>next-cube</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='microblaze'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='microblazeel'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='mips'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>malta</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='mipsel'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>malta</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='mips64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>malta</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>pica61</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>magnum</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='mips64el'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>malta</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>pica61</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>magnum</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='16'>boston</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='ppc'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mac99</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>40p</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>taihu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='ppc64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>taihu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>40p</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mac99</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='ppc64le'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>taihu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>40p</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>mac99</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='riscv32'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='8'>spike</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>opentitan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='8'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='riscv64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='8'>spike</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>shakti_c</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='8'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='s390x'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='sh4'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>shix</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>r2d</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='sh4eb'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>shix</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>r2d</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='sparc'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>SS-5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>SS-20</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>LX</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>SS-4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>SS-10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>Voyager</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='sparc64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sun4u</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>niagara</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>sun4v</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='x86_64'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>64</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='1'>isapc</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>microvm</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='kvm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <acpi default='on' toggle='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:       <apic default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='xtensa'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>sim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>kc705</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ml605</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx200</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx60</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]:   <guest>
Nov 30 09:09:37 user nova-compute[75340]:     <os_type>hvm</os_type>
Nov 30 09:09:37 user nova-compute[75340]:     <arch name='xtensaeb'>
Nov 30 09:09:37 user nova-compute[75340]:       <wordsize>32</wordsize>
Nov 30 09:09:37 user nova-compute[75340]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='4'>sim</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>kc705</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ml605</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>virt</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx200</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>lx60</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 09:09:37 user nova-compute[75340]:       <domain type='qemu'/>
Nov 30 09:09:37 user nova-compute[75340]:     </arch>
Nov 30 09:09:37 user nova-compute[75340]:     <features>
Nov 30 09:09:37 user nova-compute[75340]:       <cpuselection/>
Nov 30 09:09:37 user nova-compute[75340]:       <deviceboot/>
Nov 30 09:09:37 user nova-compute[75340]:       <disksnapshot default='on' toggle='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     </features>
Nov 30 09:09:37 user nova-compute[75340]:   </guest>
Nov 30 09:09:37 user nova-compute[75340]: </capabilities>
Nov 30 09:09:37 user nova-compute[75340]: 
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-q35-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>i686</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='288'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'/>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='lm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-i440fx-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>i686</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='255'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'/>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='lm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ide</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-i440fx-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>i686</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='255'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'/>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='lm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ide</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-q35-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>i686</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='288'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'/>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='lm'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-q35-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>x86_64</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='288'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>efi</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='invtsc'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='rsba'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-i440fx-6.2</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>x86_64</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='255'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>efi</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='invtsc'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='rsba'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ide</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-i440fx-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>x86_64</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='255'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>efi</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='invtsc'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='rsba'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ide</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 30 09:09:37 user nova-compute[75340]: <domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 09:09:37 user nova-compute[75340]:   <domain>kvm</domain>
Nov 30 09:09:37 user nova-compute[75340]:   <machine>pc-q35-jammy</machine>
Nov 30 09:09:37 user nova-compute[75340]:   <arch>x86_64</arch>
Nov 30 09:09:37 user nova-compute[75340]:   <vcpu max='288'/>
Nov 30 09:09:37 user nova-compute[75340]:   <iothreads supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:   <os supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='firmware'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>efi</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:     <loader supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>rom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pflash</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='readonly'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='secure'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>yes</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>no</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </loader>
Nov 30 09:09:37 user nova-compute[75340]:   </os>
Nov 30 09:09:37 user nova-compute[75340]:   <cpu>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-passthrough' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='hostPassthroughMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='maximum' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='maximumMigratable'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>on</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>off</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='host-model' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <vendor>Intel</vendor>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ss'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='vmx'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pcid'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='hypervisor'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arat'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='umip'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='md-clear'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='invtsc'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibpb'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='ibrs'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-stibp'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='rsba'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='erms'/>
Nov 30 09:09:37 user nova-compute[75340]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:     <mode name='custom' supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>qemu64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>qemu32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>phenom</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>pentium</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>n270</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm64</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>kvm32</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>coreduo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>core2duo</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>athlon</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Westmere</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Snowridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Skylake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>SandyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Penryn</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G5</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G4</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G3</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Opteron_G2</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Opteron_G1</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>IvyBridge</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Icelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Haswell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Rome</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-Milan</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>EPYC</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Dhyana</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cooperlake</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>Conroe</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='no'>Broadwell</model>
Nov 30 09:09:37 user nova-compute[75340]:       <model usable='yes'>486</model>
Nov 30 09:09:37 user nova-compute[75340]:     </mode>
Nov 30 09:09:37 user nova-compute[75340]:   </cpu>
Nov 30 09:09:37 user nova-compute[75340]:   <memoryBacking supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:     <enum name='sourceType'>
Nov 30 09:09:37 user nova-compute[75340]:       <value>file</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>anonymous</value>
Nov 30 09:09:37 user nova-compute[75340]:       <value>memfd</value>
Nov 30 09:09:37 user nova-compute[75340]:     </enum>
Nov 30 09:09:37 user nova-compute[75340]:   </memoryBacking>
Nov 30 09:09:37 user nova-compute[75340]:   <devices>
Nov 30 09:09:37 user nova-compute[75340]:     <disk supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='diskDevice'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>disk</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cdrom</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>floppy</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>lun</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='bus'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>fdc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sata</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </disk>
Nov 30 09:09:37 user nova-compute[75340]:     <graphics supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='type'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>sdl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vnc</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>spice</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egl-headless</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </graphics>
Nov 30 09:09:37 user nova-compute[75340]:     <video supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='modelType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>cirrus</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>vmvga</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>qxl</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>none</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>bochs</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>ramfb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </video>
Nov 30 09:09:37 user nova-compute[75340]:     <hostdev supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='mode'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>subsystem</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='startupPolicy'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>default</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>mandatory</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>requisite</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>optional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='subsysType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>usb</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>pci</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>scsi</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='capsType'/>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='pciBackend'/>
Nov 30 09:09:37 user nova-compute[75340]:     </hostdev>
Nov 30 09:09:37 user nova-compute[75340]:     <rng supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtio-non-transitional</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>random</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>egd</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>builtin</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </rng>
Nov 30 09:09:37 user nova-compute[75340]:     <filesystem supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='driverType'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>path</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>handle</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>virtiofs</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </filesystem>
Nov 30 09:09:37 user nova-compute[75340]:     <tpm supported='yes'>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='model'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-tis</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>tpm-crb</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:       <enum name='backendModel'>
Nov 30 09:09:37 user nova-compute[75340]:         <value>passthrough</value>
Nov 30 09:09:37 user nova-compute[75340]:         <value>emulator</value>
Nov 30 09:09:37 user nova-compute[75340]:       </enum>
Nov 30 09:09:37 user nova-compute[75340]:     </tpm>
Nov 30 09:09:37 user nova-compute[75340]:   </devices>
Nov 30 09:09:37 user nova-compute[75340]:   <features>
Nov 30 09:09:37 user nova-compute[75340]:     <gic supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:     <vmcoreinfo supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <genid supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backingStoreInput supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <backup supported='yes'/>
Nov 30 09:09:37 user nova-compute[75340]:     <sev supported='no'/>
Nov 30 09:09:37 user nova-compute[75340]:   </features>
Nov 30 09:09:37 user nova-compute[75340]: </domainCapabilities>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75340) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75340) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Checking secure boot support for host arch (x86_64) {{(pid=75340) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 09:09:37 user nova-compute[75340]: INFO nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Secure Boot support detected
Nov 30 09:09:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] cpu compare xml: <cpu match="exact">
Nov 30 09:09:37 user nova-compute[75340]:   <model>Nehalem</model>
Nov 30 09:09:37 user nova-compute[75340]: </cpu>
Nov 30 09:09:37 user nova-compute[75340]:  {{(pid=75340) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 30 09:09:37 user nova-compute[75340]: INFO nova.virt.node [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Generated node identity 0b79bb92-a015-438b-9e5d-504678a00853
Nov 30 09:09:37 user nova-compute[75340]: INFO nova.virt.node [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Wrote node identity 0b79bb92-a015-438b-9e5d-504678a00853 to /opt/stack/data/nova/compute_id
Nov 30 09:09:37 user nova-compute[75340]: WARNING nova.compute.manager [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Compute nodes ['0b79bb92-a015-438b-9e5d-504678a00853'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 30 09:09:38 user nova-compute[75340]: INFO nova.compute.manager [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 30 09:09:38 user nova-compute[75340]: WARNING nova.compute.manager [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 09:09:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:09:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:09:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Hypervisor/Node resource view: name=user free_ram=10999MB free_disk=26.25115203857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:09:38 user nova-compute[75340]: WARNING nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] No compute node record for user:0b79bb92-a015-438b-9e5d-504678a00853: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0b79bb92-a015-438b-9e5d-504678a00853 could not be found.
Nov 30 09:09:38 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Compute node record created for user:user with uuid: 0b79bb92-a015-438b-9e5d-504678a00853
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:09:38 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] [req-6a5ba2d4-4707-4df3-9a28-2d598a084a43] Created resource provider record via placement API for resource provider with UUID 0b79bb92-a015-438b-9e5d-504678a00853 and name user.
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75340) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 30 09:09:38 user nova-compute[75340]: INFO nova.virt.libvirt.host [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] kernel doesn't support AMD SEV
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Libvirt baseline CPU <cpu>
Nov 30 09:09:38 user nova-compute[75340]:   <arch>x86_64</arch>
Nov 30 09:09:38 user nova-compute[75340]:   <model>Nehalem</model>
Nov 30 09:09:38 user nova-compute[75340]:   <vendor>Intel</vendor>
Nov 30 09:09:38 user nova-compute[75340]:   <topology sockets="6" cores="1" threads="1"/>
Nov 30 09:09:38 user nova-compute[75340]: </cpu>
Nov 30 09:09:38 user nova-compute[75340]:  {{(pid=75340) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Updated inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Updating resource provider 0b79bb92-a015-438b-9e5d-504678a00853 generation from 0 to 1 during operation: update_inventory {{(pid=75340) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:09:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Updating resource provider 0b79bb92-a015-438b-9e5d-504678a00853 generation from 1 to 2 during operation: update_traits {{(pid=75340) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 09:09:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:09:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:09:39 user nova-compute[75340]: DEBUG nova.service [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Creating RPC server for service compute {{(pid=75340) start /opt/stack/nova/nova/service.py:182}}
Nov 30 09:09:39 user nova-compute[75340]: DEBUG nova.service [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] Join ServiceGroup membership for this service compute {{(pid=75340) start /opt/stack/nova/nova/service.py:199}}
Nov 30 09:09:39 user nova-compute[75340]: DEBUG nova.servicegroup.drivers.db [None req-e750b638-2614-4f2f-a265-9e2b4dc3f4f4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75340) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:10:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:10:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=10401MB free_disk=26.154808044433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:10:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:11:29 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:11:29 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=10331MB free_disk=26.220657348632812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:11:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:11:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:12:29 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:12:30 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:12:30 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=10309MB free_disk=25.971790313720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:12:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:12:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:12:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:31 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:13:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9670MB free_disk=25.992645263671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:13:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:38 user nova-compute[75340]: INFO nova.compute.claims [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Claim successful on node user
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.401s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:39 user nova-compute[75340]: INFO nova.compute.claims [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Claim successful on node user
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Creating image(s)
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "/opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "/opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Creating image(s)
Nov 30 09:13:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "/opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "/opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "/opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG nova.policy [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9742c099d4bb4ae2990caaace9e5875d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae4d82ae7ff45529e368d1d4eace4ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG nova.policy [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44ea0b017210427eb36856893f55725e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8863798b8e9b48309a3c365ff2ea40f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.part --force-share --output=json" returned: 0 in 0.224s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG nova.virt.images [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] a858ddd5-7e49-4452-af44-f170b5cc722b was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.part /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.part /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.converted" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.776s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:41 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkaj1hf64/privsep.sock']
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.437s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:41 user sudo[84596]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkaj1hf64/privsep.sock
Nov 30 09:13:41 user sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 09:13:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Successfully created port: 055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:43 user sudo[84596]: pam_unix(sudo:session): session closed for user root
Nov 30 09:13:43 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Spawned new privsep daemon via rootwrap
Nov 30 09:13:43 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 09:13:43 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 09:13:43 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 30 09:13:43 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84649
Nov 30 09:13:43 user nova-compute[75340]: WARNING oslo_privsep.priv_context [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] privsep daemon already running
Nov 30 09:13:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Successfully created port: 03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk 1073741824" returned: 0 in 0.049s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.243s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk 1073741824" returned: 0 in 0.049s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Cannot resize image /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Ensure instance console log exists: /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Cannot resize image /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Ensure instance console log exists: /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:44 user nova-compute[75340]: INFO nova.compute.claims [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Claim successful on node user
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Successfully updated port: 055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquired lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.271s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:44 user nova-compute[75340]: INFO nova.compute.claims [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Claim successful on node user
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Creating image(s)
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "/opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-changed-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Refreshing instance network info cache due to event network-changed-055dc2bb-d01e-45b7-9869-285be0996f52. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] Acquiring lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.policy [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14f79ef5cc314a3bb971a811a317a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9daa1b03684fb6b29fa66f0f355e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk 1073741824" returned: 0 in 0.122s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Creating image(s)
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "/opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:45 user nova-compute[75340]: INFO nova.compute.claims [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Claim successful on node user
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.policy [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea3a2d5bc1c47ea988021ed23683f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddb2f89853f41d08fbeb37811d9d4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Cannot resize image /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Ensure instance console log exists: /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.network.neutron [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updating instance_info_cache with network_info: [{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Releasing lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Instance network_info: |[{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] Acquired lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Refreshing network info cache for port 055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Start _get_guest_xml network_info=[{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317548186',display_name='tempest-ServersNegativeTestJSON-server-317548186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317548186',id=1,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-1we88dfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:40Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=240c7075-56a8-437b-9b07-cfa7914f10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lazy-loading 'pci_devices' on Instance uuid 240c7075-56a8-437b-9b07-cfa7914f10ed {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:46 user nova-compute[75340]:   <uuid>240c7075-56a8-437b-9b07-cfa7914f10ed</uuid>
Nov 30 09:13:46 user nova-compute[75340]:   <name>instance-00000001</name>
Nov 30 09:13:46 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:46 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:46 user nova-compute[75340]:   <metadata>
Nov 30 09:13:46 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:46 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:name>tempest-ServersNegativeTestJSON-server-317548186</nova:name>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:45</nova:creationTime>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:46 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:46 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:user uuid="44ea0b017210427eb36856893f55725e">tempest-ServersNegativeTestJSON-1523211864-project-member</nova:user>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:project uuid="8863798b8e9b48309a3c365ff2ea40f4">tempest-ServersNegativeTestJSON-1523211864</nova:project>
Nov 30 09:13:46 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:46 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:46 user nova-compute[75340]:         <nova:port uuid="055dc2bb-d01e-45b7-9869-285be0996f52">
Nov 30 09:13:46 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 09:13:46 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:46 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:46 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:46 user nova-compute[75340]:   </metadata>
Nov 30 09:13:46 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:46 user nova-compute[75340]:     <system>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="serial">240c7075-56a8-437b-9b07-cfa7914f10ed</entry>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="uuid">240c7075-56a8-437b-9b07-cfa7914f10ed</entry>
Nov 30 09:13:46 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:46 user nova-compute[75340]:     </system>
Nov 30 09:13:46 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:46 user nova-compute[75340]:   <os>
Nov 30 09:13:46 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:46 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:46 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:46 user nova-compute[75340]:   </os>
Nov 30 09:13:46 user nova-compute[75340]:   <features>
Nov 30 09:13:46 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:46 user nova-compute[75340]:     <apic/>
Nov 30 09:13:46 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:46 user nova-compute[75340]:   </features>
Nov 30 09:13:46 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:46 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:46 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:46 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:46 user nova-compute[75340]:   </clock>
Nov 30 09:13:46 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:46 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:46 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:46 user nova-compute[75340]:   </cpu>
Nov 30 09:13:46 user nova-compute[75340]:   <devices>
Nov 30 09:13:46 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:46 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:46 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk"/>
Nov 30 09:13:46 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:46 user nova-compute[75340]:     </disk>
Nov 30 09:13:46 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:46 user nova-compute[75340]:       <mac address="fa:16:3e:9c:2c:72"/>
Nov 30 09:13:46 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:46 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:46 user nova-compute[75340]:       <target dev="tap055dc2bb-d0"/>
Nov 30 09:13:46 user nova-compute[75340]:     </interface>
Nov 30 09:13:46 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:46 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/console.log" append="off"/>
Nov 30 09:13:46 user nova-compute[75340]:     </serial>
Nov 30 09:13:46 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:46 user nova-compute[75340]:     <video>
Nov 30 09:13:46 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:46 user nova-compute[75340]:     </video>
Nov 30 09:13:46 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:46 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:46 user nova-compute[75340]:     </rng>
Nov 30 09:13:46 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:46 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:46 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:46 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:46 user nova-compute[75340]:   </devices>
Nov 30 09:13:46 user nova-compute[75340]: </domain>
Nov 30 09:13:46 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317548186',display_name='tempest-ServersNegativeTestJSON-server-317548186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317548186',id=1,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-1we88dfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:40Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=240c7075-56a8-437b-9b07-cfa7914f10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG os_vif [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.218s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Created schema index Interface.name {{(pid=75340) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Created schema index Port.name {{(pid=75340) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Created schema index Bridge.name {{(pid=75340) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [POLLOUT] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Successfully updated port: 03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk 1073741824" returned: 0 in 0.091s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquired lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c1fd325-ddc7-57e0-9166-be3cbf06aec5', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:46 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmplxfdc1uo/privsep.sock']
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:46 user sudo[84716]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmplxfdc1uo/privsep.sock
Nov 30 09:13:46 user sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-changed-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Refreshing instance network info cache due to event network-changed-03867240-0cd4-4cfc-be50-f82a6ba87ac1. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] Acquiring lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Cannot resize image /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Ensure instance console log exists: /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Creating image(s)
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.policy [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeac2f0e248940b1b494f96c8e7535d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082add99abc342f9aa296b611fd4cb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk 1073741824" returned: 0 in 0.052s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Cannot resize image /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Ensure instance console log exists: /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:47 user sudo[84716]: pam_unix(sudo:session): session closed for user root
Nov 30 09:13:47 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Spawned new privsep daemon via rootwrap
Nov 30 09:13:47 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 09:13:47 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 09:13:47 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 30 09:13:47 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84737
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Successfully created port: 17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updated VIF entry in instance network info cache for port 055dc2bb-d01e-45b7-9869-285be0996f52. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updating instance_info_cache with network_info: [{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updating instance_info_cache with network_info: [{"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53eec796-4f17-4283-ad29-f20373db3ff1 req-b86e4392-a6c0-41cd-bb16-af5dd2db01c1 service nova] Releasing lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Releasing lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Instance network_info: |[{"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] Acquired lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Refreshing network info cache for port 03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Start _get_guest_xml network_info=[{"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:47 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:47 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-277982327',display_name='tempest-DeleteServersTestJSON-server-277982327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-277982327',id=2,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ae4d82ae7ff45529e368d1d4eace4ef',ramdisk_id='',reservation_id='r-hkmkit3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-211775344',owner_user_name='tempest-DeleteServersTestJSON-211775344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:40Z,user_data=None,user_id='9742c099d4bb4ae2990caaace9e5875d',uuid=1ba82957-aff8-4c4f-8f7b-1a5c076e124f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converting VIF {"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ba82957-aff8-4c4f-8f7b-1a5c076e124f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:48 user nova-compute[75340]:   <uuid>1ba82957-aff8-4c4f-8f7b-1a5c076e124f</uuid>
Nov 30 09:13:48 user nova-compute[75340]:   <name>instance-00000002</name>
Nov 30 09:13:48 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:48 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:48 user nova-compute[75340]:   <metadata>
Nov 30 09:13:48 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:48 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:name>tempest-DeleteServersTestJSON-server-277982327</nova:name>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:47</nova:creationTime>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:48 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:48 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:user uuid="9742c099d4bb4ae2990caaace9e5875d">tempest-DeleteServersTestJSON-211775344-project-member</nova:user>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:project uuid="7ae4d82ae7ff45529e368d1d4eace4ef">tempest-DeleteServersTestJSON-211775344</nova:project>
Nov 30 09:13:48 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:48 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:48 user nova-compute[75340]:         <nova:port uuid="03867240-0cd4-4cfc-be50-f82a6ba87ac1">
Nov 30 09:13:48 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:13:48 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:48 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:48 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:48 user nova-compute[75340]:   </metadata>
Nov 30 09:13:48 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:48 user nova-compute[75340]:     <system>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="serial">1ba82957-aff8-4c4f-8f7b-1a5c076e124f</entry>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="uuid">1ba82957-aff8-4c4f-8f7b-1a5c076e124f</entry>
Nov 30 09:13:48 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:48 user nova-compute[75340]:     </system>
Nov 30 09:13:48 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:48 user nova-compute[75340]:   <os>
Nov 30 09:13:48 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:48 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:48 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:48 user nova-compute[75340]:   </os>
Nov 30 09:13:48 user nova-compute[75340]:   <features>
Nov 30 09:13:48 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:48 user nova-compute[75340]:     <apic/>
Nov 30 09:13:48 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:48 user nova-compute[75340]:   </features>
Nov 30 09:13:48 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:48 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:48 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:48 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:48 user nova-compute[75340]:   </clock>
Nov 30 09:13:48 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:48 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:48 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:48 user nova-compute[75340]:   </cpu>
Nov 30 09:13:48 user nova-compute[75340]:   <devices>
Nov 30 09:13:48 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:48 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:48 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk"/>
Nov 30 09:13:48 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:48 user nova-compute[75340]:     </disk>
Nov 30 09:13:48 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:48 user nova-compute[75340]:       <mac address="fa:16:3e:d0:6a:c4"/>
Nov 30 09:13:48 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:48 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:48 user nova-compute[75340]:       <target dev="tap03867240-0c"/>
Nov 30 09:13:48 user nova-compute[75340]:     </interface>
Nov 30 09:13:48 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:48 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/console.log" append="off"/>
Nov 30 09:13:48 user nova-compute[75340]:     </serial>
Nov 30 09:13:48 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:48 user nova-compute[75340]:     <video>
Nov 30 09:13:48 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:48 user nova-compute[75340]:     </video>
Nov 30 09:13:48 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:48 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:48 user nova-compute[75340]:     </rng>
Nov 30 09:13:48 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:48 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:48 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:48 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:48 user nova-compute[75340]:   </devices>
Nov 30 09:13:48 user nova-compute[75340]: </domain>
Nov 30 09:13:48 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-277982327',display_name='tempest-DeleteServersTestJSON-server-277982327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-277982327',id=2,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ae4d82ae7ff45529e368d1d4eace4ef',ramdisk_id='',reservation_id='r-hkmkit3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-211775344',owner_user_name='tempest-DeleteServersTestJSON-211775344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:40Z,user_data=None,user_id='9742c099d4bb4ae2990caaace9e5875d',uuid=1ba82957-aff8-4c4f-8f7b-1a5c076e124f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converting VIF {"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG os_vif [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e92ca91-8cfd-56c5-a98f-9746cb038d0b', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03867240-0c, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03867240-0c, col_values=(('qos', UUID('3cf0f924-c404-4129-a296-6cde007f6a46')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03867240-0c, col_values=(('external_ids', {'iface-id': '03867240-0cd4-4cfc-be50-f82a6ba87ac1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:6a:c4', 'vm-uuid': '1ba82957-aff8-4c4f-8f7b-1a5c076e124f'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: INFO os_vif [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c')
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap055dc2bb-d0, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap055dc2bb-d0, col_values=(('qos', UUID('d2b95304-a372-4225-9ba0-9479dfae5b4e')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap055dc2bb-d0, col_values=(('external_ids', {'iface-id': '055dc2bb-d01e-45b7-9869-285be0996f52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:2c:72', 'vm-uuid': '240c7075-56a8-437b-9b07-cfa7914f10ed'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:48 user nova-compute[75340]: INFO os_vif [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0')
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] No VIF found with MAC fa:16:3e:d0:6a:c4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] No VIF found with MAC fa:16:3e:9c:2c:72, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Successfully created port: 41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Successfully created port: 4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:13:49 user nova-compute[75340]: INFO nova.compute.claims [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Claim successful on node user
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updated VIF entry in instance network info cache for port 03867240-0cd4-4cfc-be50-f82a6ba87ac1. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updating instance_info_cache with network_info: [{"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d013ee86-21cd-4566-bc5a-082e02f8f82f req-d7d65229-3356-4720-ac8a-642abe0c63b6 service nova] Releasing lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:13:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:13:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Creating image(s)
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "/opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.policy [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61fabd845c2a4368bab99d4ca469452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2a93601bf545c7b13b34afc2c0da24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Successfully updated port: 17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-changed-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Refreshing instance network info cache due to event network-changed-17daaea6-cbc9-4d12-851e-d03dd3a2113e. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] Acquiring lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk 1073741824" returned: 0 in 0.053s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Cannot resize image /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Ensure instance console log exists: /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Successfully updated port: 41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquired lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-changed-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Refreshing instance network info cache due to event network-changed-41652583-81c1-4a67-b474-8231b70b84aa. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] Acquiring lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Instance network_info: |[{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] Acquired lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Refreshing network info cache for port 17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Start _get_guest_xml network_info=[{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369991683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369991683',id=3,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9mul84uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:45Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=342c9729-6990-4f95-8d1e-6c3ba45a881c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 342c9729-6990-4f95-8d1e-6c3ba45a881c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:52 user nova-compute[75340]:   <uuid>342c9729-6990-4f95-8d1e-6c3ba45a881c</uuid>
Nov 30 09:13:52 user nova-compute[75340]:   <name>instance-00000003</name>
Nov 30 09:13:52 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:52 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:52 user nova-compute[75340]:   <metadata>
Nov 30 09:13:52 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:52 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1369991683</nova:name>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:52</nova:creationTime>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:52 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:port uuid="17daaea6-cbc9-4d12-851e-d03dd3a2113e">
Nov 30 09:13:52 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 09:13:52 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:52 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:52 user nova-compute[75340]:   </metadata>
Nov 30 09:13:52 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:52 user nova-compute[75340]:     <system>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="serial">342c9729-6990-4f95-8d1e-6c3ba45a881c</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="uuid">342c9729-6990-4f95-8d1e-6c3ba45a881c</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:52 user nova-compute[75340]:     </system>
Nov 30 09:13:52 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:52 user nova-compute[75340]:   <os>
Nov 30 09:13:52 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:52 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:52 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:52 user nova-compute[75340]:   </os>
Nov 30 09:13:52 user nova-compute[75340]:   <features>
Nov 30 09:13:52 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:52 user nova-compute[75340]:     <apic/>
Nov 30 09:13:52 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:52 user nova-compute[75340]:   </features>
Nov 30 09:13:52 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:52 user nova-compute[75340]:   </clock>
Nov 30 09:13:52 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:52 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:52 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:52 user nova-compute[75340]:   </cpu>
Nov 30 09:13:52 user nova-compute[75340]:   <devices>
Nov 30 09:13:52 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:52 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:52 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk"/>
Nov 30 09:13:52 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:     </disk>
Nov 30 09:13:52 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:52 user nova-compute[75340]:       <mac address="fa:16:3e:9a:67:3d"/>
Nov 30 09:13:52 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:52 user nova-compute[75340]:       <target dev="tap17daaea6-cb"/>
Nov 30 09:13:52 user nova-compute[75340]:     </interface>
Nov 30 09:13:52 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:52 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/console.log" append="off"/>
Nov 30 09:13:52 user nova-compute[75340]:     </serial>
Nov 30 09:13:52 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:52 user nova-compute[75340]:     <video>
Nov 30 09:13:52 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:     </video>
Nov 30 09:13:52 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:52 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:52 user nova-compute[75340]:     </rng>
Nov 30 09:13:52 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:52 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:52 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:52 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:52 user nova-compute[75340]:   </devices>
Nov 30 09:13:52 user nova-compute[75340]: </domain>
Nov 30 09:13:52 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369991683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369991683',id=3,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9mul84uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:45Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=342c9729-6990-4f95-8d1e-6c3ba45a881c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG os_vif [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '827e52c4-edaf-5cdf-96ed-648b898bce98', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17daaea6-cb, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17daaea6-cb, col_values=(('qos', UUID('f4e7080f-043a-4839-b333-87ccef350813')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17daaea6-cb, col_values=(('external_ids', {'iface-id': '17daaea6-cbc9-4d12-851e-d03dd3a2113e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:67:3d', 'vm-uuid': '342c9729-6990-4f95-8d1e-6c3ba45a881c'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: INFO os_vif [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb')
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:9a:67:3d, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Successfully created port: a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating instance_info_cache with network_info: [{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Releasing lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Instance network_info: |[{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] Acquired lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Refreshing network info cache for port 41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Start _get_guest_xml network_info=[{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1653516342',display_name='tempest-AttachVolumeNegativeTest-server-1653516342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1653516342',id=4,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdKaRKUVh87uXt1DoSswmxCdhjfMq9yrh3yqgIhN+yTvZD6eMjG8RMbw+/H+j7aUYqUeoSIcfmjvbm4fsd1A1dy9kai/cG/FsMGVRS1bzrmGPDeJeCdAdLJ9a9r/1gTmg==',key_name='tempest-keypair-212676230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-e0ii0qig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=30737691-a43b-44ec-93c2-b66868d553ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'pci_devices' on Instance uuid 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:52 user nova-compute[75340]:   <uuid>30737691-a43b-44ec-93c2-b66868d553ac</uuid>
Nov 30 09:13:52 user nova-compute[75340]:   <name>instance-00000004</name>
Nov 30 09:13:52 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:52 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:52 user nova-compute[75340]:   <metadata>
Nov 30 09:13:52 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:52 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1653516342</nova:name>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:52</nova:creationTime>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:52 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:user uuid="fea3a2d5bc1c47ea988021ed23683f08">tempest-AttachVolumeNegativeTest-689840258-project-member</nova:user>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:project uuid="4ddb2f89853f41d08fbeb37811d9d4e8">tempest-AttachVolumeNegativeTest-689840258</nova:project>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:52 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:52 user nova-compute[75340]:         <nova:port uuid="41652583-81c1-4a67-b474-8231b70b84aa">
Nov 30 09:13:52 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 09:13:52 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:52 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:52 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:52 user nova-compute[75340]:   </metadata>
Nov 30 09:13:52 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:52 user nova-compute[75340]:     <system>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="serial">30737691-a43b-44ec-93c2-b66868d553ac</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="uuid">30737691-a43b-44ec-93c2-b66868d553ac</entry>
Nov 30 09:13:52 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:52 user nova-compute[75340]:     </system>
Nov 30 09:13:52 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:52 user nova-compute[75340]:   <os>
Nov 30 09:13:52 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:52 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:52 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:52 user nova-compute[75340]:   </os>
Nov 30 09:13:52 user nova-compute[75340]:   <features>
Nov 30 09:13:52 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:52 user nova-compute[75340]:     <apic/>
Nov 30 09:13:52 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:52 user nova-compute[75340]:   </features>
Nov 30 09:13:52 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:52 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:52 user nova-compute[75340]:   </clock>
Nov 30 09:13:52 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:52 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:52 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:52 user nova-compute[75340]:   </cpu>
Nov 30 09:13:52 user nova-compute[75340]:   <devices>
Nov 30 09:13:52 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:52 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:52 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk"/>
Nov 30 09:13:52 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:     </disk>
Nov 30 09:13:52 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:52 user nova-compute[75340]:       <mac address="fa:16:3e:82:79:c4"/>
Nov 30 09:13:52 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:52 user nova-compute[75340]:       <target dev="tap41652583-81"/>
Nov 30 09:13:52 user nova-compute[75340]:     </interface>
Nov 30 09:13:52 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:52 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/console.log" append="off"/>
Nov 30 09:13:52 user nova-compute[75340]:     </serial>
Nov 30 09:13:52 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:52 user nova-compute[75340]:     <video>
Nov 30 09:13:52 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:52 user nova-compute[75340]:     </video>
Nov 30 09:13:52 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:52 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:52 user nova-compute[75340]:     </rng>
Nov 30 09:13:52 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:52 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:52 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:52 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:52 user nova-compute[75340]:   </devices>
Nov 30 09:13:52 user nova-compute[75340]: </domain>
Nov 30 09:13:52 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1653516342',display_name='tempest-AttachVolumeNegativeTest-server-1653516342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1653516342',id=4,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdKaRKUVh87uXt1DoSswmxCdhjfMq9yrh3yqgIhN+yTvZD6eMjG8RMbw+/H+j7aUYqUeoSIcfmjvbm4fsd1A1dy9kai/cG/FsMGVRS1bzrmGPDeJeCdAdLJ9a9r/1gTmg==',key_name='tempest-keypair-212676230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-e0ii0qig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=30737691-a43b-44ec-93c2-b66868d553ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG os_vif [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49347274-deb5-5248-9a06-5dbc076b6db3', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Successfully updated port: 4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41652583-81, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41652583-81, col_values=(('qos', UUID('0b34a21d-b77a-4a8b-b46d-d59ca3e1dc19')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41652583-81, col_values=(('external_ids', {'iface-id': '41652583-81c1-4a67-b474-8231b70b84aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:79:c4', 'vm-uuid': '30737691-a43b-44ec-93c2-b66868d553ac'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: INFO os_vif [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81')
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:82:79:c4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-changed-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Refreshing instance network info cache due to event network-changed-4948b73b-dc7f-4720-8006-1232706b4aac. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:13:52 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Instance spawned successfully.
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:13:52 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Instance spawned successfully.
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:53 user nova-compute[75340]: INFO nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Took 13.33 seconds to spawn the instance on the hypervisor.
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:13:53 user nova-compute[75340]: INFO nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Took 13.02 seconds to spawn the instance on the hypervisor.
Nov 30 09:13:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:13:53 user nova-compute[75340]: INFO nova.compute.manager [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Took 14.45 seconds to build instance.
Nov 30 09:13:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3742a4b-04b5-4496-b2a0-58eae8900c1c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.832s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:53 user nova-compute[75340]: INFO nova.compute.manager [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Took 14.50 seconds to build instance.
Nov 30 09:13:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-502b04e9-7f86-4487-88fc-df0437e9959e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.997s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updated VIF entry in instance network info cache for port 17daaea6-cbc9-4d12-851e-d03dd3a2113e. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a6c7b01-24b8-422b-8909-39c2ad170de7 req-1e4639a1-730f-4fe5-9b54-2b0d0469e842 service nova] Releasing lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance network_info: |[{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Refreshing network info cache for port 4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start _get_guest_xml network_info=[{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updated VIF entry in instance network info cache for port 41652583-81c1-4a67-b474-8231b70b84aa. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.neutron [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating instance_info_cache with network_info: [{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0f473eb-578d-46e4-abc2-b4de4028556d req-31c692cf-4cfb-44f2-a74f-d809e62fc81a service nova] Releasing lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'pci_devices' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:54 user nova-compute[75340]:   <uuid>cd3f40a8-6a0f-4116-b654-e222153dd2a4</uuid>
Nov 30 09:13:54 user nova-compute[75340]:   <name>instance-00000005</name>
Nov 30 09:13:54 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:54 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:54 user nova-compute[75340]:   <metadata>
Nov 30 09:13:54 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:54 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherB-server-1737055794</nova:name>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:54</nova:creationTime>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:54 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:54 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:user uuid="aeac2f0e248940b1b494f96c8e7535d5">tempest-ServerActionsTestOtherB-642872739-project-member</nova:user>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:project uuid="082add99abc342f9aa296b611fd4cb85">tempest-ServerActionsTestOtherB-642872739</nova:project>
Nov 30 09:13:54 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:54 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:54 user nova-compute[75340]:         <nova:port uuid="4948b73b-dc7f-4720-8006-1232706b4aac">
Nov 30 09:13:54 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:13:54 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:54 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:54 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:54 user nova-compute[75340]:   </metadata>
Nov 30 09:13:54 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:54 user nova-compute[75340]:     <system>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="serial">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="uuid">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:13:54 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:54 user nova-compute[75340]:     </system>
Nov 30 09:13:54 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:54 user nova-compute[75340]:   <os>
Nov 30 09:13:54 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:54 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:54 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:54 user nova-compute[75340]:   </os>
Nov 30 09:13:54 user nova-compute[75340]:   <features>
Nov 30 09:13:54 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:54 user nova-compute[75340]:     <apic/>
Nov 30 09:13:54 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:54 user nova-compute[75340]:   </features>
Nov 30 09:13:54 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:54 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:54 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:54 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:54 user nova-compute[75340]:   </clock>
Nov 30 09:13:54 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:54 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:54 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:54 user nova-compute[75340]:   </cpu>
Nov 30 09:13:54 user nova-compute[75340]:   <devices>
Nov 30 09:13:54 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:54 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:54 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk"/>
Nov 30 09:13:54 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:54 user nova-compute[75340]:     </disk>
Nov 30 09:13:54 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:54 user nova-compute[75340]:       <mac address="fa:16:3e:f5:c0:76"/>
Nov 30 09:13:54 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:54 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:54 user nova-compute[75340]:       <target dev="tap4948b73b-dc"/>
Nov 30 09:13:54 user nova-compute[75340]:     </interface>
Nov 30 09:13:54 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:54 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/console.log" append="off"/>
Nov 30 09:13:54 user nova-compute[75340]:     </serial>
Nov 30 09:13:54 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:54 user nova-compute[75340]:     <video>
Nov 30 09:13:54 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:54 user nova-compute[75340]:     </video>
Nov 30 09:13:54 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:54 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:54 user nova-compute[75340]:     </rng>
Nov 30 09:13:54 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:54 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:54 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:54 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:54 user nova-compute[75340]:   </devices>
Nov 30 09:13:54 user nova-compute[75340]: </domain>
Nov 30 09:13:54 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG os_vif [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '494210f0-3a33-59bb-8377-c4cfecdc7f41', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4948b73b-dc, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4948b73b-dc, col_values=(('qos', UUID('e5349791-71e4-4155-91e1-6cad191dd022')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4948b73b-dc, col_values=(('external_ids', {'iface-id': '4948b73b-dc7f-4720-8006-1232706b4aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:76', 'vm-uuid': 'cd3f40a8-6a0f-4116-b654-e222153dd2a4'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:54 user nova-compute[75340]: INFO os_vif [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No VIF found with MAC fa:16:3e:f5:c0:76, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Successfully updated port: a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing instance network info cache due to event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updated VIF entry in instance network info cache for port 4948b73b-dc7f-4720-8006-1232706b4aac. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3df11807-8e6a-4d78-a677-e03431dead5a req-1b817d77-536d-4415-93c3-3d0e5fcd6f05 service nova] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:13:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Instance network_info: |[{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Start _get_guest_xml network_info=[{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-43643442',display_name='tempest-ServerActionsTestOtherA-server-43643442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-43643442',id=6,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-q72hkzyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=21360976-bd14-407a-82f3-7543a1f052b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'pci_devices' on Instance uuid 21360976-bd14-407a-82f3-7543a1f052b3 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:13:57 user nova-compute[75340]:   <uuid>21360976-bd14-407a-82f3-7543a1f052b3</uuid>
Nov 30 09:13:57 user nova-compute[75340]:   <name>instance-00000006</name>
Nov 30 09:13:57 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:13:57 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:13:57 user nova-compute[75340]:   <metadata>
Nov 30 09:13:57 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:13:57 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherA-server-43643442</nova:name>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:13:57</nova:creationTime>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:13:57 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:13:57 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:owner>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:user uuid="61fabd845c2a4368bab99d4ca469452a">tempest-ServerActionsTestOtherA-1563000763-project-member</nova:user>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:project uuid="5c2a93601bf545c7b13b34afc2c0da24">tempest-ServerActionsTestOtherA-1563000763</nova:project>
Nov 30 09:13:57 user nova-compute[75340]:       </nova:owner>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:13:57 user nova-compute[75340]:       <nova:ports>
Nov 30 09:13:57 user nova-compute[75340]:         <nova:port uuid="a643fa77-0868-48a4-8fa9-0e40ea283e70">
Nov 30 09:13:57 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 09:13:57 user nova-compute[75340]:         </nova:port>
Nov 30 09:13:57 user nova-compute[75340]:       </nova:ports>
Nov 30 09:13:57 user nova-compute[75340]:     </nova:instance>
Nov 30 09:13:57 user nova-compute[75340]:   </metadata>
Nov 30 09:13:57 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:13:57 user nova-compute[75340]:     <system>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="serial">21360976-bd14-407a-82f3-7543a1f052b3</entry>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="uuid">21360976-bd14-407a-82f3-7543a1f052b3</entry>
Nov 30 09:13:57 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:13:57 user nova-compute[75340]:     </system>
Nov 30 09:13:57 user nova-compute[75340]:   </sysinfo>
Nov 30 09:13:57 user nova-compute[75340]:   <os>
Nov 30 09:13:57 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:13:57 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:13:57 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:13:57 user nova-compute[75340]:   </os>
Nov 30 09:13:57 user nova-compute[75340]:   <features>
Nov 30 09:13:57 user nova-compute[75340]:     <acpi/>
Nov 30 09:13:57 user nova-compute[75340]:     <apic/>
Nov 30 09:13:57 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:13:57 user nova-compute[75340]:   </features>
Nov 30 09:13:57 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:13:57 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:13:57 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:13:57 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:13:57 user nova-compute[75340]:   </clock>
Nov 30 09:13:57 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:13:57 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:13:57 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:13:57 user nova-compute[75340]:   </cpu>
Nov 30 09:13:57 user nova-compute[75340]:   <devices>
Nov 30 09:13:57 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:13:57 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:13:57 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk"/>
Nov 30 09:13:57 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:13:57 user nova-compute[75340]:     </disk>
Nov 30 09:13:57 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:13:57 user nova-compute[75340]:       <mac address="fa:16:3e:b8:d1:dc"/>
Nov 30 09:13:57 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:57 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:13:57 user nova-compute[75340]:       <target dev="tapa643fa77-08"/>
Nov 30 09:13:57 user nova-compute[75340]:     </interface>
Nov 30 09:13:57 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:13:57 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/console.log" append="off"/>
Nov 30 09:13:57 user nova-compute[75340]:     </serial>
Nov 30 09:13:57 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:13:57 user nova-compute[75340]:     <video>
Nov 30 09:13:57 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:13:57 user nova-compute[75340]:     </video>
Nov 30 09:13:57 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:13:57 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:13:57 user nova-compute[75340]:     </rng>
Nov 30 09:13:57 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:13:57 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:13:57 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:13:57 user nova-compute[75340]:     </memballoon>
Nov 30 09:13:57 user nova-compute[75340]:   </devices>
Nov 30 09:13:57 user nova-compute[75340]: </domain>
Nov 30 09:13:57 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-43643442',display_name='tempest-ServerActionsTestOtherA-server-43643442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-43643442',id=6,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-q72hkzyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=21360976-bd14-407a-82f3-7543a1f052b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG os_vif [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26234e26-d198-5518-baf9-c23aa09214ad', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa643fa77-08, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa643fa77-08, col_values=(('qos', UUID('0ac588c3-2e29-4457-bb07-fba5a68aa944')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa643fa77-08, col_values=(('external_ids', {'iface-id': 'a643fa77-0868-48a4-8fa9-0e40ea283e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:d1:dc', 'vm-uuid': '21360976-bd14-407a-82f3-7543a1f052b3'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: INFO os_vif [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08')
Nov 30 09:13:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:13:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:b8:d1:dc, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:13:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:13:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:00 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Instance spawned successfully.
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated VIF entry in instance network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea3110e-7ec4-4f0a-8217-dd4f169aaf5c req-bdff0046-381c-47d3-a56b-3f8a1691d0e6 service nova] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:00 user nova-compute[75340]: INFO nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Took 15.37 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:00 user nova-compute[75340]: INFO nova.compute.manager [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Took 16.27 seconds to build instance.
Nov 30 09:14:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ec1dd88-bc8a-40d0-85eb-c1d3b4253fc3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.446s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:01 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Instance spawned successfully.
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:01 user nova-compute[75340]: INFO nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Took 15.71 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:01 user nova-compute[75340]: INFO nova.compute.manager [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Took 17.23 seconds to build instance.
Nov 30 09:14:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7ac2725-9d5c-488e-93fe-331507478e99 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.526s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance spawned successfully.
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:02 user nova-compute[75340]: INFO nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Took 16.04 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:03 user nova-compute[75340]: INFO nova.compute.manager [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Took 17.31 seconds to build instance.
Nov 30 09:14:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f85b6dfd-7193-4510-b64b-cc80471416b8 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.509s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Instance spawned successfully.
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:03 user nova-compute[75340]: INFO nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Took 13.07 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:03 user nova-compute[75340]: INFO nova.compute.manager [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Took 14.13 seconds to build instance.
Nov 30 09:14:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0846b1bc-437e-4f6f-9f46-f6ebe24ebb6a tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.239s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:10 user nova-compute[75340]: INFO nova.compute.claims [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Claim successful on node user
Nov 30 09:14:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.539s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:11 user nova-compute[75340]: INFO nova.compute.claims [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Claim successful on node user
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.policy [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0837b767a8c4b2aa7dbb1b57ad36190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832e825eaf1a4caba355a217dbfea563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:14:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Creating image(s)
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.part --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.virt.images [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] 91f2aaa9-b7a9-4351-be60-6c96f48f658b was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.part /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.part /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.converted" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.324s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Successfully created port: ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651.converted --force-share --output=json" returned: 0 in 0.289s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.119s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG nova.policy [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5b50ed776a541748fbfc920306c4f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6721267c2994f9b9af9947a9e228d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:14:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Creating image(s)
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "/opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "/opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651,backing_fmt=raw /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651,backing_fmt=raw /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk 1073741824" returned: 0 in 0.092s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "215d2ca87b8bb5714859a59c28d8e1cb35981651" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.266s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:13 user nova-compute[75340]: INFO nova.compute.claims [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Claim successful on node user
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk 1073741824" returned: 0 in 0.071s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 --force-share --output=json" returned: 0 in 0.391s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Cannot resize image /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Ensure instance console log exists: /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Cannot resize image /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Ensure instance console log exists: /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.264s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] No waiting events found dispatching network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:14 user nova-compute[75340]: WARNING nova.compute.manager [req-bd305e29-80b5-43e6-b5b9-285c5a7e0239 req-fd298e12-26bf-4263-8134-67eb0470bcf2 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received unexpected event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 for instance with vm_state active and task_state None.
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:14 user nova-compute[75340]: INFO nova.compute.claims [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Claim successful on node user
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Successfully updated port: ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Successfully created port: 8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquired lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.policy [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ee8b1b90db42768cc3ee61d1454f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ec812897b740438e7f8c6aaf1f245c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:14:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Creating image(s)
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updating instance_info_cache with network_info: [{"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Releasing lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Instance network_info: |[{"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Start _get_guest_xml network_info=[{"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:14:00Z,direct_url=<?>,disk_format='qcow2',id=91f2aaa9-b7a9-4351-be60-6c96f48f658b,min_disk=0,min_ram=0,name='',owner='4b3a7ecfbaf346e292acca3158beb589',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:14:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '91f2aaa9-b7a9-4351-be60-6c96f48f658b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:14:00Z,direct_url=<?>,disk_format='qcow2',id=91f2aaa9-b7a9-4351-be60-6c96f48f658b,min_disk=0,min_ram=0,name='',owner='4b3a7ecfbaf346e292acca3158beb589',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:14:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99391822',display_name='tempest-AttachSCSIVolumeTestJSON-server-99391822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99391822',id=7,image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDXybglUF2cai4BtEsLjVfvDYYXYCSqC2/ZKG2swIxAmAFLJ1Gv5Dm6S4YwxQcas3bMcO3F0wbMwokgXHi3HOb63slLRKQOqZ3G+CBTKVLd/0gdupC4T5p0eUDTIcVRXQ==',key_name='tempest-keypair-116354532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='832e825eaf1a4caba355a217dbfea563',ramdisk_id='',reservation_id='r-8w65odaw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-848279881',owner_user_name='tempest-AttachSCSIVolumeTestJSON-848279881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0837b767a8c4b2aa7dbb1b57ad36190',uuid=983d3252-e5e7-4cfb-aab1-c717c754a700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converting VIF {"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lazy-loading 'pci_devices' on Instance uuid 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:14:15 user nova-compute[75340]:   <uuid>983d3252-e5e7-4cfb-aab1-c717c754a700</uuid>
Nov 30 09:14:15 user nova-compute[75340]:   <name>instance-00000007</name>
Nov 30 09:14:15 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:14:15 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:14:15 user nova-compute[75340]:   <metadata>
Nov 30 09:14:15 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:14:15 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-99391822</nova:name>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:14:15</nova:creationTime>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:14:15 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:14:15 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:owner>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:user uuid="f0837b767a8c4b2aa7dbb1b57ad36190">tempest-AttachSCSIVolumeTestJSON-848279881-project-member</nova:user>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:project uuid="832e825eaf1a4caba355a217dbfea563">tempest-AttachSCSIVolumeTestJSON-848279881</nova:project>
Nov 30 09:14:15 user nova-compute[75340]:       </nova:owner>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:root type="image" uuid="91f2aaa9-b7a9-4351-be60-6c96f48f658b"/>
Nov 30 09:14:15 user nova-compute[75340]:       <nova:ports>
Nov 30 09:14:15 user nova-compute[75340]:         <nova:port uuid="ffd3921c-2171-4680-aec2-ad94ad431420">
Nov 30 09:14:15 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:14:15 user nova-compute[75340]:         </nova:port>
Nov 30 09:14:15 user nova-compute[75340]:       </nova:ports>
Nov 30 09:14:15 user nova-compute[75340]:     </nova:instance>
Nov 30 09:14:15 user nova-compute[75340]:   </metadata>
Nov 30 09:14:15 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:14:15 user nova-compute[75340]:     <system>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="serial">983d3252-e5e7-4cfb-aab1-c717c754a700</entry>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="uuid">983d3252-e5e7-4cfb-aab1-c717c754a700</entry>
Nov 30 09:14:15 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:14:15 user nova-compute[75340]:     </system>
Nov 30 09:14:15 user nova-compute[75340]:   </sysinfo>
Nov 30 09:14:15 user nova-compute[75340]:   <os>
Nov 30 09:14:15 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:14:15 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:14:15 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:14:15 user nova-compute[75340]:   </os>
Nov 30 09:14:15 user nova-compute[75340]:   <features>
Nov 30 09:14:15 user nova-compute[75340]:     <acpi/>
Nov 30 09:14:15 user nova-compute[75340]:     <apic/>
Nov 30 09:14:15 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:14:15 user nova-compute[75340]:   </features>
Nov 30 09:14:15 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:14:15 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:14:15 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:14:15 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:14:15 user nova-compute[75340]:   </clock>
Nov 30 09:14:15 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:14:15 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:14:15 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:14:15 user nova-compute[75340]:   </cpu>
Nov 30 09:14:15 user nova-compute[75340]:   <devices>
Nov 30 09:14:15 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:14:15 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:14:15 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk"/>
Nov 30 09:14:15 user nova-compute[75340]:       <target dev="sda" bus="scsi"/>
Nov 30 09:14:15 user nova-compute[75340]:       <address type="drive" controller="0" unit="0"/>
Nov 30 09:14:15 user nova-compute[75340]:     </disk>
Nov 30 09:14:15 user nova-compute[75340]:     <disk type="file" device="cdrom">
Nov 30 09:14:15 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 09:14:15 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.config"/>
Nov 30 09:14:15 user nova-compute[75340]:       <target dev="sdb" bus="scsi"/>
Nov 30 09:14:15 user nova-compute[75340]:       <address type="drive" controller="0" unit="1"/>
Nov 30 09:14:15 user nova-compute[75340]:     </disk>
Nov 30 09:14:15 user nova-compute[75340]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 30 09:14:15 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:14:15 user nova-compute[75340]:       <mac address="fa:16:3e:83:5c:9c"/>
Nov 30 09:14:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:15 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:14:15 user nova-compute[75340]:       <target dev="tapffd3921c-21"/>
Nov 30 09:14:15 user nova-compute[75340]:     </interface>
Nov 30 09:14:15 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:14:15 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/console.log" append="off"/>
Nov 30 09:14:15 user nova-compute[75340]:     </serial>
Nov 30 09:14:15 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:14:15 user nova-compute[75340]:     <video>
Nov 30 09:14:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:15 user nova-compute[75340]:     </video>
Nov 30 09:14:15 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:14:15 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:14:15 user nova-compute[75340]:     </rng>
Nov 30 09:14:15 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:14:15 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:14:15 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:14:15 user nova-compute[75340]:     </memballoon>
Nov 30 09:14:15 user nova-compute[75340]:   </devices>
Nov 30 09:14:15 user nova-compute[75340]: </domain>
Nov 30 09:14:15 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99391822',display_name='tempest-AttachSCSIVolumeTestJSON-server-99391822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99391822',id=7,image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDXybglUF2cai4BtEsLjVfvDYYXYCSqC2/ZKG2swIxAmAFLJ1Gv5Dm6S4YwxQcas3bMcO3F0wbMwokgXHi3HOb63slLRKQOqZ3G+CBTKVLd/0gdupC4T5p0eUDTIcVRXQ==',key_name='tempest-keypair-116354532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='832e825eaf1a4caba355a217dbfea563',ramdisk_id='',reservation_id='r-8w65odaw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-848279881',owner_user_name='tempest-AttachSCSIVolumeTestJSON-848279881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0837b767a8c4b2aa7dbb1b57ad36190',uuid=983d3252-e5e7-4cfb-aab1-c717c754a700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converting VIF {"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG os_vif [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8b598d5-8414-5d6d-9782-1adb1b817da6', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffd3921c-21, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffd3921c-21, col_values=(('qos', UUID('b56fb4ea-c071-4386-a0eb-5cc458075b71')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffd3921c-21, col_values=(('external_ids', {'iface-id': 'ffd3921c-2171-4680-aec2-ad94ad431420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5c:9c', 'vm-uuid': '983d3252-e5e7-4cfb-aab1-c717c754a700'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:15 user nova-compute[75340]: INFO os_vif [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21')
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk 1073741824" returned: 0 in 0.070s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No BDM found with device name sda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No VIF found with MAC fa:16:3e:83:5c:9c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:14:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Using config drive
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.policy [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1669dccd0871427287b8841f4482712f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c8193bbc14d508a71f44256da1640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:14:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Creating image(s)
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "/opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "/opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Cannot resize image /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Ensure instance console log exists: /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk 1073741824" returned: 0 in 0.059s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Creating config drive at /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.config
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqwdeebla {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Successfully updated port: 8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqwdeebla" returned: 0 in 0.100s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquired lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.266s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Successfully created port: 9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Successfully created port: 4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Cannot resize image /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Ensure instance console log exists: /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-changed-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Refreshing instance network info cache due to event network-changed-ffd3921c-2171-4680-aec2-ad94ad431420. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Acquiring lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Acquired lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Refreshing network info cache for port ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updating instance_info_cache with network_info: [{"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Releasing lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Instance network_info: |[{"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Start _get_guest_xml network_info=[{"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:14:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-641821850',display_name='tempest-VolumesAdminNegativeTest-server-641821850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-641821850',id=8,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrTe6b+dpPCj9qjMocTRv7UkLOSWB8ZY+Co8xRvArvTrD8x9w2t4u4UXXWgrywSeMMtmt1Q5DRFDjj5zKsJdWYWpYYDBx3AlQbwKStIPoI2xct/HFoQc89VAgrdEXH45A==',key_name='tempest-keypair-410102207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-mup99wfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5b50ed776a541748fbfc920306c4f43',uuid=b2d40060-d7cc-4038-9f91-8551ba7576f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'pci_devices' on Instance uuid b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:14:17 user nova-compute[75340]:   <uuid>b2d40060-d7cc-4038-9f91-8551ba7576f9</uuid>
Nov 30 09:14:17 user nova-compute[75340]:   <name>instance-00000008</name>
Nov 30 09:14:17 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:14:17 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:14:17 user nova-compute[75340]:   <metadata>
Nov 30 09:14:17 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:14:17 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:name>tempest-VolumesAdminNegativeTest-server-641821850</nova:name>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:14:16</nova:creationTime>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:14:17 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:14:17 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:owner>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:user uuid="a5b50ed776a541748fbfc920306c4f43">tempest-VolumesAdminNegativeTest-1287326145-project-member</nova:user>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:project uuid="c6721267c2994f9b9af9947a9e228d72">tempest-VolumesAdminNegativeTest-1287326145</nova:project>
Nov 30 09:14:17 user nova-compute[75340]:       </nova:owner>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:14:17 user nova-compute[75340]:       <nova:ports>
Nov 30 09:14:17 user nova-compute[75340]:         <nova:port uuid="8ba14a9a-668f-409f-9cfd-de357918856b">
Nov 30 09:14:17 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:14:17 user nova-compute[75340]:         </nova:port>
Nov 30 09:14:17 user nova-compute[75340]:       </nova:ports>
Nov 30 09:14:17 user nova-compute[75340]:     </nova:instance>
Nov 30 09:14:17 user nova-compute[75340]:   </metadata>
Nov 30 09:14:17 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:14:17 user nova-compute[75340]:     <system>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="serial">b2d40060-d7cc-4038-9f91-8551ba7576f9</entry>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="uuid">b2d40060-d7cc-4038-9f91-8551ba7576f9</entry>
Nov 30 09:14:17 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:14:17 user nova-compute[75340]:     </system>
Nov 30 09:14:17 user nova-compute[75340]:   </sysinfo>
Nov 30 09:14:17 user nova-compute[75340]:   <os>
Nov 30 09:14:17 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:14:17 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:14:17 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:14:17 user nova-compute[75340]:   </os>
Nov 30 09:14:17 user nova-compute[75340]:   <features>
Nov 30 09:14:17 user nova-compute[75340]:     <acpi/>
Nov 30 09:14:17 user nova-compute[75340]:     <apic/>
Nov 30 09:14:17 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:14:17 user nova-compute[75340]:   </features>
Nov 30 09:14:17 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:14:17 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:14:17 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:14:17 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:14:17 user nova-compute[75340]:   </clock>
Nov 30 09:14:17 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:14:17 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:14:17 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:14:17 user nova-compute[75340]:   </cpu>
Nov 30 09:14:17 user nova-compute[75340]:   <devices>
Nov 30 09:14:17 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:14:17 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:14:17 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk"/>
Nov 30 09:14:17 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:14:17 user nova-compute[75340]:     </disk>
Nov 30 09:14:17 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:14:17 user nova-compute[75340]:       <mac address="fa:16:3e:c1:19:91"/>
Nov 30 09:14:17 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:17 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:14:17 user nova-compute[75340]:       <target dev="tap8ba14a9a-66"/>
Nov 30 09:14:17 user nova-compute[75340]:     </interface>
Nov 30 09:14:17 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:14:17 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/console.log" append="off"/>
Nov 30 09:14:17 user nova-compute[75340]:     </serial>
Nov 30 09:14:17 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:14:17 user nova-compute[75340]:     <video>
Nov 30 09:14:17 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:17 user nova-compute[75340]:     </video>
Nov 30 09:14:17 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:14:17 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:14:17 user nova-compute[75340]:     </rng>
Nov 30 09:14:17 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:14:17 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:14:17 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:14:17 user nova-compute[75340]:     </memballoon>
Nov 30 09:14:17 user nova-compute[75340]:   </devices>
Nov 30 09:14:17 user nova-compute[75340]: </domain>
Nov 30 09:14:17 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-641821850',display_name='tempest-VolumesAdminNegativeTest-server-641821850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-641821850',id=8,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrTe6b+dpPCj9qjMocTRv7UkLOSWB8ZY+Co8xRvArvTrD8x9w2t4u4UXXWgrywSeMMtmt1Q5DRFDjj5zKsJdWYWpYYDBx3AlQbwKStIPoI2xct/HFoQc89VAgrdEXH45A==',key_name='tempest-keypair-410102207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-mup99wfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5b50ed776a541748fbfc920306c4f43',uuid=b2d40060-d7cc-4038-9f91-8551ba7576f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG os_vif [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0708bbfd-36cf-5a34-a3de-2eb50d5c6ba1', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ba14a9a-66, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ba14a9a-66, col_values=(('qos', UUID('01aedf94-314e-474f-8820-d6bd020a426b')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ba14a9a-66, col_values=(('external_ids', {'iface-id': '8ba14a9a-668f-409f-9cfd-de357918856b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:19:91', 'vm-uuid': 'b2d40060-d7cc-4038-9f91-8551ba7576f9'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: INFO os_vif [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66')
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No VIF found with MAC fa:16:3e:c1:19:91, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Successfully updated port: 9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updated VIF entry in instance network info cache for port ffd3921c-2171-4680-aec2-ad94ad431420. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updating instance_info_cache with network_info: [{"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Releasing lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] No waiting events found dispatching network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:17 user nova-compute[75340]: WARNING nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received unexpected event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 for instance with vm_state active and task_state None.
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-changed-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Refreshing instance network info cache due to event network-changed-8ba14a9a-668f-409f-9cfd-de357918856b. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Acquiring lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Acquired lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Refreshing network info cache for port 8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Successfully updated port: 4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquired lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-changed-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Refreshing instance network info cache due to event network-changed-4d07b2b8-9b11-4908-9f55-71ee0996123f. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] Acquiring lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Instance network_info: |[{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Start _get_guest_xml network_info=[{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:14:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'pci_devices' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:14:18 user nova-compute[75340]:   <uuid>8737b5bb-6bdb-4293-bae8-3857aded9074</uuid>
Nov 30 09:14:18 user nova-compute[75340]:   <name>instance-00000009</name>
Nov 30 09:14:18 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:14:18 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:14:18 user nova-compute[75340]:   <metadata>
Nov 30 09:14:18 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:14:18 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:name>tempest-device-tagging-server-2065242471</nova:name>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:14:17</nova:creationTime>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:14:18 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:14:18 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:owner>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:user uuid="94ee8b1b90db42768cc3ee61d1454f58">tempest-TaggedAttachmentsTest-716106286-project-member</nova:user>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:project uuid="e4ec812897b740438e7f8c6aaf1f245c">tempest-TaggedAttachmentsTest-716106286</nova:project>
Nov 30 09:14:18 user nova-compute[75340]:       </nova:owner>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:14:18 user nova-compute[75340]:       <nova:ports>
Nov 30 09:14:18 user nova-compute[75340]:         <nova:port uuid="9ec18e6c-a83d-430b-bf00-0719c095b253">
Nov 30 09:14:18 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:14:18 user nova-compute[75340]:         </nova:port>
Nov 30 09:14:18 user nova-compute[75340]:       </nova:ports>
Nov 30 09:14:18 user nova-compute[75340]:     </nova:instance>
Nov 30 09:14:18 user nova-compute[75340]:   </metadata>
Nov 30 09:14:18 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:14:18 user nova-compute[75340]:     <system>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="serial">8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="uuid">8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:14:18 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:14:18 user nova-compute[75340]:     </system>
Nov 30 09:14:18 user nova-compute[75340]:   </sysinfo>
Nov 30 09:14:18 user nova-compute[75340]:   <os>
Nov 30 09:14:18 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:14:18 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:14:18 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:14:18 user nova-compute[75340]:   </os>
Nov 30 09:14:18 user nova-compute[75340]:   <features>
Nov 30 09:14:18 user nova-compute[75340]:     <acpi/>
Nov 30 09:14:18 user nova-compute[75340]:     <apic/>
Nov 30 09:14:18 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:14:18 user nova-compute[75340]:   </features>
Nov 30 09:14:18 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:14:18 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:14:18 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:14:18 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:14:18 user nova-compute[75340]:   </clock>
Nov 30 09:14:18 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:14:18 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:14:18 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:14:18 user nova-compute[75340]:   </cpu>
Nov 30 09:14:18 user nova-compute[75340]:   <devices>
Nov 30 09:14:18 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:14:18 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:14:18 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk"/>
Nov 30 09:14:18 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:14:18 user nova-compute[75340]:     </disk>
Nov 30 09:14:18 user nova-compute[75340]:     <disk type="file" device="cdrom">
Nov 30 09:14:18 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 09:14:18 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config"/>
Nov 30 09:14:18 user nova-compute[75340]:       <target dev="hda" bus="ide"/>
Nov 30 09:14:18 user nova-compute[75340]:     </disk>
Nov 30 09:14:18 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:14:18 user nova-compute[75340]:       <mac address="fa:16:3e:b5:e3:d1"/>
Nov 30 09:14:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:18 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:14:18 user nova-compute[75340]:       <target dev="tap9ec18e6c-a8"/>
Nov 30 09:14:18 user nova-compute[75340]:     </interface>
Nov 30 09:14:18 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:14:18 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log" append="off"/>
Nov 30 09:14:18 user nova-compute[75340]:     </serial>
Nov 30 09:14:18 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:14:18 user nova-compute[75340]:     <video>
Nov 30 09:14:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:18 user nova-compute[75340]:     </video>
Nov 30 09:14:18 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:14:18 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:14:18 user nova-compute[75340]:     </rng>
Nov 30 09:14:18 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:14:18 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:14:18 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:14:18 user nova-compute[75340]:     </memballoon>
Nov 30 09:14:18 user nova-compute[75340]:   </devices>
Nov 30 09:14:18 user nova-compute[75340]: </domain>
Nov 30 09:14:18 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG os_vif [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ddff97b-5f88-5332-87f9-e050af3ff260', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ec18e6c-a8, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ec18e6c-a8, col_values=(('qos', UUID('30a913dc-4036-4c8d-9893-eb026c5b7166')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ec18e6c-a8, col_values=(('external_ids', {'iface-id': '9ec18e6c-a83d-430b-bf00-0719c095b253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e3:d1', 'vm-uuid': '8737b5bb-6bdb-4293-bae8-3857aded9074'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: INFO os_vif [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8')
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No VIF found with MAC fa:16:3e:b5:e3:d1, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:14:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Using config drive
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updated VIF entry in instance network info cache for port 8ba14a9a-668f-409f-9cfd-de357918856b. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updating instance_info_cache with network_info: [{"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-71f40ae9-9b67-436f-b398-7b1d102fa9a5 req-c4892145-1462-409c-b031-fc9725f031cb service nova] Releasing lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updating instance_info_cache with network_info: [{"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Releasing lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Instance network_info: |[{"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] Acquired lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Refreshing network info cache for port 4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Start _get_guest_xml network_info=[{"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-changed-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing instance network info cache due to event network-changed-9ec18e6c-a83d-430b-bf00-0719c095b253. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing network info cache for port 9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:14:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1476208229',display_name='tempest-TestVolumeSwap-server-1476208229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1476208229',id=10,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQkkhl9Tdt5iF9fUwBv3VZp1KEDCC5Zt1qb91GToAg6E27ktJGYBUveu1eCnhmqDa/xaR2y/9rVpz4eMOFF8UxGEDFa17+f5M0yEU1qN1IjKB0+a/lmeWZVPgUQhf9byg==',key_name='tempest-keypair-261378391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef8c8193bbc14d508a71f44256da1640',ramdisk_id='',reservation_id='r-g5bz5022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2068553882',owner_user_name='tempest-TestVolumeSwap-2068553882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1669dccd0871427287b8841f4482712f',uuid=ef858fe4-a912-4729-9f48-11e473364f13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converting VIF {"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lazy-loading 'pci_devices' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Creating config drive at /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config
Nov 30 09:14:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8e36zdmh {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:14:19 user nova-compute[75340]:   <uuid>ef858fe4-a912-4729-9f48-11e473364f13</uuid>
Nov 30 09:14:19 user nova-compute[75340]:   <name>instance-0000000a</name>
Nov 30 09:14:19 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:14:19 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:14:19 user nova-compute[75340]:   <metadata>
Nov 30 09:14:19 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:14:19 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:name>tempest-TestVolumeSwap-server-1476208229</nova:name>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:14:18</nova:creationTime>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:14:19 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:14:19 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:owner>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:user uuid="1669dccd0871427287b8841f4482712f">tempest-TestVolumeSwap-2068553882-project-member</nova:user>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:project uuid="ef8c8193bbc14d508a71f44256da1640">tempest-TestVolumeSwap-2068553882</nova:project>
Nov 30 09:14:19 user nova-compute[75340]:       </nova:owner>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:14:19 user nova-compute[75340]:       <nova:ports>
Nov 30 09:14:19 user nova-compute[75340]:         <nova:port uuid="4d07b2b8-9b11-4908-9f55-71ee0996123f">
Nov 30 09:14:19 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:14:19 user nova-compute[75340]:         </nova:port>
Nov 30 09:14:19 user nova-compute[75340]:       </nova:ports>
Nov 30 09:14:19 user nova-compute[75340]:     </nova:instance>
Nov 30 09:14:19 user nova-compute[75340]:   </metadata>
Nov 30 09:14:19 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:14:19 user nova-compute[75340]:     <system>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="serial">ef858fe4-a912-4729-9f48-11e473364f13</entry>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="uuid">ef858fe4-a912-4729-9f48-11e473364f13</entry>
Nov 30 09:14:19 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:14:19 user nova-compute[75340]:     </system>
Nov 30 09:14:19 user nova-compute[75340]:   </sysinfo>
Nov 30 09:14:19 user nova-compute[75340]:   <os>
Nov 30 09:14:19 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:14:19 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:14:19 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:14:19 user nova-compute[75340]:   </os>
Nov 30 09:14:19 user nova-compute[75340]:   <features>
Nov 30 09:14:19 user nova-compute[75340]:     <acpi/>
Nov 30 09:14:19 user nova-compute[75340]:     <apic/>
Nov 30 09:14:19 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:14:19 user nova-compute[75340]:   </features>
Nov 30 09:14:19 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:14:19 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:14:19 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:14:19 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:14:19 user nova-compute[75340]:   </clock>
Nov 30 09:14:19 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:14:19 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:14:19 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:14:19 user nova-compute[75340]:   </cpu>
Nov 30 09:14:19 user nova-compute[75340]:   <devices>
Nov 30 09:14:19 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:14:19 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:14:19 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk"/>
Nov 30 09:14:19 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:14:19 user nova-compute[75340]:     </disk>
Nov 30 09:14:19 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:14:19 user nova-compute[75340]:       <mac address="fa:16:3e:e4:25:4f"/>
Nov 30 09:14:19 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:19 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:14:19 user nova-compute[75340]:       <target dev="tap4d07b2b8-9b"/>
Nov 30 09:14:19 user nova-compute[75340]:     </interface>
Nov 30 09:14:19 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:14:19 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/console.log" append="off"/>
Nov 30 09:14:19 user nova-compute[75340]:     </serial>
Nov 30 09:14:19 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:14:19 user nova-compute[75340]:     <video>
Nov 30 09:14:19 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:19 user nova-compute[75340]:     </video>
Nov 30 09:14:19 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:14:19 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:14:19 user nova-compute[75340]:     </rng>
Nov 30 09:14:19 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:14:19 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:14:19 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:14:19 user nova-compute[75340]:     </memballoon>
Nov 30 09:14:19 user nova-compute[75340]:   </devices>
Nov 30 09:14:19 user nova-compute[75340]: </domain>
Nov 30 09:14:19 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1476208229',display_name='tempest-TestVolumeSwap-server-1476208229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1476208229',id=10,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQkkhl9Tdt5iF9fUwBv3VZp1KEDCC5Zt1qb91GToAg6E27ktJGYBUveu1eCnhmqDa/xaR2y/9rVpz4eMOFF8UxGEDFa17+f5M0yEU1qN1IjKB0+a/lmeWZVPgUQhf9byg==',key_name='tempest-keypair-261378391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef8c8193bbc14d508a71f44256da1640',ramdisk_id='',reservation_id='r-g5bz5022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2068553882',owner_user_name='tempest-TestVolumeSwap-2068553882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1669dccd0871427287b8841f4482712f',uuid=ef858fe4-a912-4729-9f48-11e473364f13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converting VIF {"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG os_vif [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '884f2de7-de90-53ca-8998-c452e551de16', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8e36zdmh" returned: 0 in 0.120s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d07b2b8-9b, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d07b2b8-9b, col_values=(('qos', UUID('753f3f68-d61e-488a-bcdf-6d20f9fac3d2')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d07b2b8-9b, col_values=(('external_ids', {'iface-id': '4d07b2b8-9b11-4908-9f55-71ee0996123f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:25:4f', 'vm-uuid': 'ef858fe4-a912-4729-9f48-11e473364f13'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: INFO os_vif [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b')
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] No VIF found with MAC fa:16:3e:e4:25:4f, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updated VIF entry in instance network info cache for port 9ec18e6c-a83d-430b-bf00-0719c095b253. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e45d3cd0-d27b-4831-baa6-fbbc3b8da9de req-a2d239d9-65ba-47e0-a915-47fdb77bcfa8 service nova] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updated VIF entry in instance network info cache for port 4d07b2b8-9b11-4908-9f55-71ee0996123f. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updating instance_info_cache with network_info: [{"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33b8ea56-126e-4b14-bdba-2009dbb44aaf req-a39dde3a-8e01-42b8-8865-57d01e670eb7 service nova] Releasing lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] No waiting events found dispatching network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:20 user nova-compute[75340]: WARNING nova.compute.manager [req-04c99c02-507b-4a06-b460-689eaf88fc05 req-58863097-ae44-466a-90ff-87fad96d91cc service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received unexpected event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 for instance with vm_state active and task_state None.
Nov 30 09:14:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] No waiting events found dispatching network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:21 user nova-compute[75340]: WARNING nova.compute.manager [req-0d6afde3-dc57-4b2b-9adb-5168eec59a6c req-825c7cd6-0de2-450e-838b-75cef2569f99 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received unexpected event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e for instance with vm_state active and task_state None.
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:21 user nova-compute[75340]: INFO nova.compute.claims [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Claim successful on node user
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:21 user nova-compute[75340]: DEBUG nova.policy [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d6ea228a4e47b8b8b925e39394f1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdae7248c564f9db914033cb93ed716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:14:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Creating image(s)
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "/opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "/opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "/opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.217s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk 1073741824" returned: 0 in 0.057s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Successfully created port: 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] No waiting events found dispatching network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:22 user nova-compute[75340]: WARNING nova.compute.manager [req-18612e3d-d8de-43ab-95f7-37b5dbc38943 req-dafc8cfc-c19b-4566-84f2-4416210ec2b7 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received unexpected event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 for instance with vm_state active and task_state None.
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Cannot resize image /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Ensure instance console log exists: /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] No waiting events found dispatching network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:23 user nova-compute[75340]: WARNING nova.compute.manager [req-253af4b1-957c-4e11-881b-e4af126834ba req-7526260f-b2ac-432d-bce7-db5a4492bd7d service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received unexpected event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e for instance with vm_state active and task_state None.
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Successfully updated port: 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquired lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updating instance_info_cache with network_info: [{"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:23 user nova-compute[75340]: WARNING nova.compute.manager [req-78c6bb84-6f6c-4eaf-bcce-26e0c31f10d4 req-84e68a06-0902-441c-ac87-14fd8f7475ad service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 for instance with vm_state building and task_state spawning.
Nov 30 09:14:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Releasing lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Instance network_info: |[{"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Start _get_guest_xml network_info=[{"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:14:23 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:23 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110503839',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110503839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110503839',id=11,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiIGi/0wQXB9VmtWd4sR5Yz1y/NkI8gM1Yq2VHbJYAD5b8pOPJHEnueVG6kVHVfXmdOjS2lUgT7IbY78W9uYrZN0BRGXIg6Jm1/GTmCxtRKcLe2Pb/MxXRXx6ErVYfgvA==',key_name='tempest-keypair-1917757242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdae7248c564f9db914033cb93ed716',ramdisk_id='',reservation_id='r-58xyonsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-765787768',owner_user_name='tempest-VolumesAssistedSnapshotsTest-765787768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d6ea228a4e47b8b8b925e39394f1c1',uuid=96cb8988-b8a9-46f8-903a-29f26dfaba1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converting VIF {"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.objects.instance [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lazy-loading 'pci_devices' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:14:23 user nova-compute[75340]:   <uuid>96cb8988-b8a9-46f8-903a-29f26dfaba1c</uuid>
Nov 30 09:14:23 user nova-compute[75340]:   <name>instance-0000000b</name>
Nov 30 09:14:23 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:14:23 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:14:23 user nova-compute[75340]:   <metadata>
Nov 30 09:14:23 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:14:23 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1110503839</nova:name>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:14:23</nova:creationTime>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:14:23 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:14:23 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:owner>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:user uuid="60d6ea228a4e47b8b8b925e39394f1c1">tempest-VolumesAssistedSnapshotsTest-765787768-project-member</nova:user>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:project uuid="2bdae7248c564f9db914033cb93ed716">tempest-VolumesAssistedSnapshotsTest-765787768</nova:project>
Nov 30 09:14:23 user nova-compute[75340]:       </nova:owner>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:14:23 user nova-compute[75340]:       <nova:ports>
Nov 30 09:14:23 user nova-compute[75340]:         <nova:port uuid="64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e">
Nov 30 09:14:23 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:14:23 user nova-compute[75340]:         </nova:port>
Nov 30 09:14:23 user nova-compute[75340]:       </nova:ports>
Nov 30 09:14:23 user nova-compute[75340]:     </nova:instance>
Nov 30 09:14:23 user nova-compute[75340]:   </metadata>
Nov 30 09:14:23 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:14:23 user nova-compute[75340]:     <system>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="serial">96cb8988-b8a9-46f8-903a-29f26dfaba1c</entry>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="uuid">96cb8988-b8a9-46f8-903a-29f26dfaba1c</entry>
Nov 30 09:14:23 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:14:23 user nova-compute[75340]:     </system>
Nov 30 09:14:23 user nova-compute[75340]:   </sysinfo>
Nov 30 09:14:23 user nova-compute[75340]:   <os>
Nov 30 09:14:23 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:14:23 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:14:23 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:14:23 user nova-compute[75340]:   </os>
Nov 30 09:14:23 user nova-compute[75340]:   <features>
Nov 30 09:14:23 user nova-compute[75340]:     <acpi/>
Nov 30 09:14:23 user nova-compute[75340]:     <apic/>
Nov 30 09:14:23 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:14:23 user nova-compute[75340]:   </features>
Nov 30 09:14:23 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:14:23 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:14:23 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:14:23 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:14:23 user nova-compute[75340]:   </clock>
Nov 30 09:14:23 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:14:23 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:14:23 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:14:23 user nova-compute[75340]:   </cpu>
Nov 30 09:14:23 user nova-compute[75340]:   <devices>
Nov 30 09:14:23 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:14:23 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:14:23 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk"/>
Nov 30 09:14:23 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:14:23 user nova-compute[75340]:     </disk>
Nov 30 09:14:23 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:14:23 user nova-compute[75340]:       <mac address="fa:16:3e:aa:22:d5"/>
Nov 30 09:14:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:23 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:14:23 user nova-compute[75340]:       <target dev="tap64ae3b34-0f"/>
Nov 30 09:14:23 user nova-compute[75340]:     </interface>
Nov 30 09:14:23 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:14:23 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/console.log" append="off"/>
Nov 30 09:14:23 user nova-compute[75340]:     </serial>
Nov 30 09:14:23 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:14:23 user nova-compute[75340]:     <video>
Nov 30 09:14:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:14:23 user nova-compute[75340]:     </video>
Nov 30 09:14:23 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:14:23 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:14:23 user nova-compute[75340]:     </rng>
Nov 30 09:14:23 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:14:23 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:14:23 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:14:23 user nova-compute[75340]:     </memballoon>
Nov 30 09:14:23 user nova-compute[75340]:   </devices>
Nov 30 09:14:23 user nova-compute[75340]: </domain>
Nov 30 09:14:23 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110503839',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110503839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110503839',id=11,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiIGi/0wQXB9VmtWd4sR5Yz1y/NkI8gM1Yq2VHbJYAD5b8pOPJHEnueVG6kVHVfXmdOjS2lUgT7IbY78W9uYrZN0BRGXIg6Jm1/GTmCxtRKcLe2Pb/MxXRXx6ErVYfgvA==',key_name='tempest-keypair-1917757242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdae7248c564f9db914033cb93ed716',ramdisk_id='',reservation_id='r-58xyonsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-765787768',owner_user_name='tempest-VolumesAssistedSnapshotsTest-765787768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d6ea228a4e47b8b8b925e39394f1c1',uuid=96cb8988-b8a9-46f8-903a-29f26dfaba1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converting VIF {"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG os_vif [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5b9a14a-36a0-5a0c-a2d3-f041ab11aa04', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ae3b34-0f, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ae3b34-0f, col_values=(('qos', UUID('f884d402-bf98-44d8-a998-a7d383c2a94a')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ae3b34-0f, col_values=(('external_ids', {'iface-id': '64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:22:d5', 'vm-uuid': '96cb8988-b8a9-46f8-903a-29f26dfaba1c'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: INFO os_vif [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f')
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] No VIF found with MAC fa:16:3e:aa:22:d5, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:14:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Instance spawned successfully.
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:24 user nova-compute[75340]: INFO nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Took 12.98 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:24 user nova-compute[75340]: INFO nova.compute.manager [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Took 14.21 seconds to build instance.
Nov 30 09:14:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9ce9a478-a421-4288-8afa-ce12a4d32dfa tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.471s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-changed-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Refreshing instance network info cache due to event network-changed-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] Acquiring lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] Acquired lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:24 user nova-compute[75340]: DEBUG nova.network.neutron [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Refreshing network info cache for port 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updated VIF entry in instance network info cache for port 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updating instance_info_cache with network_info: [{"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7369062a-5eb4-442f-9170-98472689ba7b req-79a3a148-edf9-4a93-bff3-7ff241390364 service nova] Releasing lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:25 user nova-compute[75340]: WARNING nova.compute.manager [req-08fb398d-ead9-4362-b58c-319fa07b5097 req-6367fcfd-10e6-431d-a213-83bc3aa9c2dc service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 for instance with vm_state building and task_state spawning.
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Instance spawned successfully.
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Instance spawned successfully.
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Instance spawned successfully.
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Took 10.42 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Took 11.25 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Took 13.03 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Took 11.92 seconds to build instance.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1d75deec-56e4-491c-90c2-c527260230e9 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.266s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Took 12.69 seconds to build instance.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-abd52a4f-df92-4453-b576-29159f60db8e tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.900s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:26 user nova-compute[75340]: INFO nova.compute.manager [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Took 15.54 seconds to build instance.
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-07e1cd77-e3a0-44c0-b478-d035e462c3d2 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.686s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] No waiting events found dispatching network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:26 user nova-compute[75340]: WARNING nova.compute.manager [req-85282131-37fc-45b7-b973-844dd96f06e1 req-d495b9e7-a21a-456b-923e-6290b8a3ff1c service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received unexpected event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa for instance with vm_state active and task_state None.
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:14:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Instance spawned successfully.
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:14:27 user nova-compute[75340]: INFO nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 30 09:14:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:14:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:28 user nova-compute[75340]: INFO nova.compute.manager [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Took 6.87 seconds to build instance.
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-317646f0-596b-4a08-b06c-bca8dc1d4c65 tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] No waiting events found dispatching network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:28 user nova-compute[75340]: WARNING nova.compute.manager [req-efbf2297-b39f-4f03-89dc-32258da03b2f req-9e73dbf9-a09f-4514-aa98-bfa272a0263e service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received unexpected event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa for instance with vm_state active and task_state None.
Nov 30 09:14:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:14:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 240c7075-56a8-437b-9b07-cfa7914f10ed {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:32 user nova-compute[75340]: WARNING nova.compute.manager [req-f60a6a6e-10e5-48df-ae5f-a6a1c61272cc req-619f8eb8-784f-47e7-8228-25a2b5a5d951 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state None.
Nov 30 09:14:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updating instance_info_cache with network_info: [{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG nova.compute.manager [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG nova.compute.manager [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] No waiting events found dispatching network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:33 user nova-compute[75340]: WARNING nova.compute.manager [req-49dc16ec-98b1-4973-8e32-1fded8bd8bb6 req-efc7bb03-a8a4-4d38-9dad-86f8ec95248f service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received unexpected event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 for instance with vm_state active and task_state None.
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:34 user nova-compute[75340]: WARNING nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state None.
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] No waiting events found dispatching network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:34 user nova-compute[75340]: WARNING nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received unexpected event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e for instance with vm_state active and task_state None.
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] No waiting events found dispatching network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:34 user nova-compute[75340]: WARNING nova.compute.manager [req-dd085ed9-9c9e-4bb9-a92c-25576a0331a7 req-9709a704-96bb-410f-9726-93d18ccb24be service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received unexpected event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e for instance with vm_state active and task_state None.
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] No waiting events found dispatching network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:35 user nova-compute[75340]: WARNING nova.compute.manager [req-874ce622-341c-4ea7-a12a-f30720e89c8d req-0b9ea91a-3902-4f7e-91a6-9a6acf2027e3 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received unexpected event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 for instance with vm_state active and task_state None.
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:14:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:14:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:14:38 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7582MB free_disk=25.669219970703125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:14:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 1ba82957-aff8-4c4f-8f7b-1a5c076e124f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 30737691-a43b-44ec-93c2-b66868d553ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 983d3252-e5e7-4cfb-aab1-c717c754a700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8737b5bb-6bdb-4293-bae8-3857aded9074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance ef858fe4-a912-4729-9f48-11e473364f13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] No waiting events found dispatching network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:39 user nova-compute[75340]: WARNING nova.compute.manager [req-9f8463bb-3cf0-484c-8943-1ebc734070e6 req-309b3955-1980-449c-862d-7ac78828b260 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received unexpected event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 for instance with vm_state active and task_state None.
Nov 30 09:14:40 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:40 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:40 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:14:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.522s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] No waiting events found dispatching network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:41 user nova-compute[75340]: WARNING nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received unexpected event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 for instance with vm_state active and task_state None.
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] No waiting events found dispatching network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:41 user nova-compute[75340]: WARNING nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received unexpected event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b for instance with vm_state active and task_state None.
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] No waiting events found dispatching network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:41 user nova-compute[75340]: WARNING nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received unexpected event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b for instance with vm_state active and task_state None.
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] No waiting events found dispatching network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:41 user nova-compute[75340]: WARNING nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received unexpected event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f for instance with vm_state active and task_state None.
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] No waiting events found dispatching network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:14:41 user nova-compute[75340]: WARNING nova.compute.manager [req-64ee777c-6256-4308-ae9f-46bc66644b30 req-0258600b-edf0-4a31-81f0-4e7763768bcd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received unexpected event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f for instance with vm_state active and task_state None.
Nov 30 09:14:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:14:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:14:57 user nova-compute[75340]: INFO nova.compute.claims [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Claim successful on node user
Nov 30 09:14:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:14:58 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:14:58 user nova-compute[75340]: INFO nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Booting with volume f1c04531-0c0e-42c7-93e5-ec37f2bae95f at /dev/vda
Nov 30 09:14:58 user nova-compute[75340]: DEBUG nova.policy [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb8b26c84cc4e869edeec4cbd17ad05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242d410e64b146608432809b9de3ddaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:14:58 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:14:58 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmqkmku_o/privsep.sock']
Nov 30 09:14:58 user sudo[86895]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmqkmku_o/privsep.sock
Nov 30 09:14:58 user sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 09:14:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:14:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully created port: b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully created port: 324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:14:59 user sudo[86895]: pam_unix(sudo:session): session closed for user root
Nov 30 09:15:00 user nova-compute[75340]: INFO oslo.privsep.daemon [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Spawned new privsep daemon via rootwrap
Nov 30 09:15:00 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 09:15:00 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 09:15:00 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 30 09:15:00 user nova-compute[75340]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86898
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5c3f8f-bec6-43d0-828c-d5549fe9bc61]: (2,) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully created port: 12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d9525-de4b-44fa-9638-3d5015f9963d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: WARNING os_brick.initiator.connectors.nvmeof [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4947c62d-0688-4e78-841a-38dbdb9ba409]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5eb6bf-b258-402a-beef-b692daad2bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ddd36c-5f36-4e5c-8ad7-1ea392a10e9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:00 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:15:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83b086-31f4-4667-971d-c75e1cd298d0]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== get_connector_properties: return (1711ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating existing volume attachment record: 104c7d5c-cd9a-4a30-acd2-a0d060e1ebdb {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:15:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully created port: e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:15:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully created port: 8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-b91bee94-c03b-4c39-942a-c69ba5d153a8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6dffa-7528-460e-a062-6b2a89d24045 req-9eeadb3b-ee8c-400d-bf76-82cfa23fed60 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: 69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-69282295-ea46-4e44-ad8b-baf3afc662ca. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port 69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: 324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-f29296f3-eda1-4039-9561-f5588f663248. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b90d8eee-914c-4346-a328-adc6cc9cf09b req-f7868a1a-29c3-4952-9269-00801474c312 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:05 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: 12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-324667bd-a18f-47f9-b0ec-9a3097b915a2. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port 324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-12a0ff8d-859c-456c-a0de-b437089898d0. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port 12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:06 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-17098a66-703d-432a-9aeb-8c313d14c208 req-b8033244-e03f-4d5a-9592-689aeffbd2f3 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Successfully updated port: 8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:15:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance network_info: |[{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updated VIF entry in instance network info cache for port e6d71e38-852a-4c2c-8fb9-5403b0fa30ce. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-8d98b117-d9a7-441c-a3b3-7d928bd80eb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port 8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:09 user nova-compute[75340]: INFO nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Booting with volume 61551bff-e2cc-4969-a73a-e0cd52dd7323 at /dev/vdb
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d4d731-2a56-425f-80a9-62f04d7c9e38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff767243-b0ce-4d3a-aed9-2b0dfd5bb711]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda9d68b-9226-41b8-ba3a-f49030f8c77a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb86d80-27cd-4765-9573-af3bd9542e13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:09 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:15:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cd0a0-3401-4b79-af39-85dcc3e195c8]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:09 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating existing volume attachment record: 50a19eac-17af-4bf1-82c7-2df5b99294c5 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:15:10 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updated VIF entry in instance network info cache for port 8d98b117-d9a7-441c-a3b3-7d928bd80eb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:10 user nova-compute[75340]: DEBUG nova.network.neutron [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-de546abb-39ce-4332-9e63-03fa271c7744 req-39bea560-4ec8-4ec4-8eb6-08c5dcd5c91a service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:18 user nova-compute[75340]: INFO nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Booting with volume b4ad071d-4010-40c7-8cdd-70860a5c4b7a at /dev/vdc
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f1e897-5cb3-47f5-b9c0-94dc31be6312]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba176cee-e8bf-4e87-8ea5-ed914e8dd197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5fec07-60c1-4147-9310-8ef8a5940162]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55862999-56ca-4dc4-bc6d-ad0420a01238]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:18 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:15:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4296c1-c33c-4875-a7f1-9f8a4fdd915d]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG os_brick.utils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating existing volume attachment record: 784b6041-9a2f-40b6-9368-d06b5176c34f {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:15:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:15:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Creating image(s)
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Ensure instance console log exists: /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Start _get_guest_xml network_info=[{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '104c7d5c-cd9a-4a30-acd2-a0d060e1ebdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdpwHEhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42302861-cfa2-4ee8-a769-d8cd942f44e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 'serial': 'f1c04531-0c0e-42c7-93e5-ec37f2bae95f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '50a19eac-17af-4bf1-82c7-2df5b99294c5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMWAIRoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42302861-cfa2-4ee8-a769-d8cd942f44e7', 'attached_at': '', 'detached_at': '', 'volume_id': '61551bff-e2cc-4969-a73a-e0cd52dd7323', 'serial': '61551bff-e2cc-4969-a73a-e0cd52dd7323'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '784b6041-9a2f-40b6-9368-d06b5176c34f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFygNnuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42302861-cfa2-4ee8-a769-d8cd942f44e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 'serial': 'b4ad071d-4010-40c7-8cdd-70860a5c4b7a'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:15:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connector [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Factory for ISCSI on None {{(pid=75340) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdpwHEhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:27 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0dfb4c-4ef5-4f65-a9a7-2fbf3ef99e15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:15:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7ac94-a995-4b53-ae2f-9c44c3aa63e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f] added
Nov 30 09:15:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca81a92-41cf-4de2-bdc4-d4ca4adf6cdb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d86000d-3ef6-4a79-b7fb-e0decb9de86a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdpwHEhx {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdpwHEhx" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2f24b-b8ea-4523-8b1f-762dbf1f1c1e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdpwHEhx'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfcb8bd-b5fc-4327-aecd-0d758224492e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77d08b-3548-4a5b-83fe-2596aa20f276]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:15:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:15:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:15:27 user nova-compute[75340]: 
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1ff8af-d9aa-492d-b5a0-a263e0cfddad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260]
Nov 30 09:15:27 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b6e0de-1fe6-416e-949e-121b6e1d47df]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e51c17-78ab-4236-95fe-2cac27bde948]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[39805bbb-d760-4e5b-8122-17b1fb67a5f2]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:15:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdpwHEhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26338356362326635', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338356362326635', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMWAIRoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:28 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:28 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:28 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:15:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b6118-d2e4-4756-b072-3d3e1b0cb223]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:15:29 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade152cd-3fbd-4a74-b04e-37d0dd726c54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323] added
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16f6ae-3b53-4f07-9681-f5bb02ad4d3b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5086b-6398-4f40-851c-04c6939b56ca]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMWAIRoc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMWAIRoc" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7f665-42fd-4533-b8ab-90b5c786e16b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMWAIRoc'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0885ad9-e7a5-4107-b3e3-d711ad6b941c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0a1de-a01a-4011-8901-fc1ab389d103]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447ace7-e0cf-433c-b868-4e5c7edc49cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260]
Nov 30 09:15:29 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6403d30-e45b-4ecc-a383-43962832c411]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2405547c-9157-4ca3-8524-ef18dac1c9f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:29 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:29 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac41173-da5f-4ffd-ac5a-0af92b4554c1]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMWAIRoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:29 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:15:29 user nova-compute[75340]: INFO nova.compute.claims [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Claim successful on node user
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26334653133303431', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334653133303431', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFygNnuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:30 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:30 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:30 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64f896-e477-4786-af09-991bb16ed441]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:15:30 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ba21b4-8f2c-4b11-93ab-b2eb015bde1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a] added
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef5e4f1-acb6-4cce-80d6-09d0ea0983be]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d0aa4-fcd0-42da-ad39-afc6f169f397]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFygNnuc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFygNnuc" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bc9cf-dc12-4bdd-8e0b-25578414db0b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFygNnuc'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa0181-6d49-4a0e-b7e5-a0aeb3a780b5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[72221cfc-4daa-48d3-b7f8-768db2f33661]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb325b-5c45-4579-a40e-eb04310f23c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260]
Nov 30 09:15:30 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[806c01db-1faf-4040-8066-b44586ae427f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68342a6-e7a8-4386-a1cb-462797c290c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:30 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.policy [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44ea0b017210427eb36856893f55725e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8863798b8e9b48309a3c365ff2ea40f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[989bd1ce-2085-437f-aafa-f68c126916e5]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFygNnuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:15:30 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Creating image(s)
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "/opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "/opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Successfully created port: 0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk 1073741824" returned: 0 in 0.085s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lazy-loading 'flavor' on Instance uuid 1ba82957-aff8-4c4f-8f7b-1a5c076e124f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Cannot resize image /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Ensure instance console log exists: /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:31 user nova-compute[75340]: INFO nova.compute.manager [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Attaching volume e390e081-a067-47e3-9c44-e390a71b55c0 to /dev/vdb
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23034316435303631', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034316435303631', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.utils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b926ef20-a1f1-462e-a86c-61a502d1673e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lazy-loading 'pci_devices' on Instance uuid 42302861-cfa2-4ee8-a769-d8cd942f44e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b856f1f-7622-4de1-9d34-e8221747606b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:15:31 user nova-compute[75340]:   <uuid>42302861-cfa2-4ee8-a769-d8cd942f44e7</uuid>
Nov 30 09:15:31 user nova-compute[75340]:   <name>instance-0000000c</name>
Nov 30 09:15:31 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:15:31 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:15:31 user nova-compute[75340]:   <metadata>
Nov 30 09:15:31 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:15:31 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:name>tempest-device-tagging-server-1843631414</nova:name>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:15:27</nova:creationTime>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:15:31 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:15:31 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:owner>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:user uuid="eeb8b26c84cc4e869edeec4cbd17ad05">tempest-TaggedBootDevicesTest-46414645-project-member</nova:user>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:project uuid="242d410e64b146608432809b9de3ddaf">tempest-TaggedBootDevicesTest-46414645</nova:project>
Nov 30 09:15:31 user nova-compute[75340]:       </nova:owner>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:15:31 user nova-compute[75340]:       <nova:ports>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="b91bee94-c03b-4c39-942a-c69ba5d153a8">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="69282295-ea46-4e44-ad8b-baf3afc662ca">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="f29296f3-eda1-4039-9561-f5588f663248">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="324667bd-a18f-47f9-b0ec-9a3097b915a2">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="12a0ff8d-859c-456c-a0de-b437089898d0">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="e6d71e38-852a-4c2c-8fb9-5403b0fa30ce">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:         <nova:port uuid="8d98b117-d9a7-441c-a3b3-7d928bd80eb8">
Nov 30 09:15:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 09:15:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:31 user nova-compute[75340]:       </nova:ports>
Nov 30 09:15:31 user nova-compute[75340]:     </nova:instance>
Nov 30 09:15:31 user nova-compute[75340]:   </metadata>
Nov 30 09:15:31 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:15:31 user nova-compute[75340]:     <system>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="serial">42302861-cfa2-4ee8-a769-d8cd942f44e7</entry>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="uuid">42302861-cfa2-4ee8-a769-d8cd942f44e7</entry>
Nov 30 09:15:31 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:15:31 user nova-compute[75340]:     </system>
Nov 30 09:15:31 user nova-compute[75340]:   </sysinfo>
Nov 30 09:15:31 user nova-compute[75340]:   <os>
Nov 30 09:15:31 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:15:31 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:15:31 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:15:31 user nova-compute[75340]:   </os>
Nov 30 09:15:31 user nova-compute[75340]:   <features>
Nov 30 09:15:31 user nova-compute[75340]:     <acpi/>
Nov 30 09:15:31 user nova-compute[75340]:     <apic/>
Nov 30 09:15:31 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:15:31 user nova-compute[75340]:   </features>
Nov 30 09:15:31 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:15:31 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:15:31 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:15:31 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:15:31 user nova-compute[75340]:   </clock>
Nov 30 09:15:31 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:15:31 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:15:31 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:15:31 user nova-compute[75340]:   </cpu>
Nov 30 09:15:31 user nova-compute[75340]:   <devices>
Nov 30 09:15:31 user nova-compute[75340]:     <disk type="file" device="cdrom">
Nov 30 09:15:31 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 09:15:31 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/disk.config"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="hda" bus="ide"/>
Nov 30 09:15:31 user nova-compute[75340]:     </disk>
Nov 30 09:15:31 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:15:31 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:15:31 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <serial>f1c04531-0c0e-42c7-93e5-ec37f2bae95f</serial>
Nov 30 09:15:31 user nova-compute[75340]:     </disk>
Nov 30 09:15:31 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:15:31 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:15:31 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <serial>61551bff-e2cc-4969-a73a-e0cd52dd7323</serial>
Nov 30 09:15:31 user nova-compute[75340]:     </disk>
Nov 30 09:15:31 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:15:31 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:15:31 user nova-compute[75340]:       <source dev="/dev/sdd"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="vdc" bus="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <serial>b4ad071d-4010-40c7-8cdd-70860a5c4b7a</serial>
Nov 30 09:15:31 user nova-compute[75340]:     </disk>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:e5:79:c5"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tapb91bee94-c0"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:81:e5:e8"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tap69282295-ea"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:2a:e6:8b"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tapf29296f3-ed"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:b8:44:5c"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tap324667bd-a1"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:52:4c:38"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tap12a0ff8d-85"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:3b:74:a5"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tape6d71e38-85"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:31 user nova-compute[75340]:       <mac address="fa:16:3e:97:80:e5"/>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:31 user nova-compute[75340]:       <target dev="tap8d98b117-d9"/>
Nov 30 09:15:31 user nova-compute[75340]:     </interface>
Nov 30 09:15:31 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:15:31 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/console.log" append="off"/>
Nov 30 09:15:31 user nova-compute[75340]:     </serial>
Nov 30 09:15:31 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:15:31 user nova-compute[75340]:     <video>
Nov 30 09:15:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:31 user nova-compute[75340]:     </video>
Nov 30 09:15:31 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:15:31 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:15:31 user nova-compute[75340]:     </rng>
Nov 30 09:15:31 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:15:31 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:15:31 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:15:31 user nova-compute[75340]:     </memballoon>
Nov 30 09:15:31 user nova-compute[75340]:   </devices>
Nov 30 09:15:31 user nova-compute[75340]: </domain>
Nov 30 09:15:31 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf45176-3fe5-4b81-b49f-a50ae059bb3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[12214a6f-cfd8-4716-b94c-9a58e666fbc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffeeb69f-dc47-567b-b20f-a021281bdbd8', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Successfully updated port: 0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-changed-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Refreshing instance network info cache due to event network-changed-0944cc1e-80be-484d-b85f-8efdc5b9a44c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] Acquiring lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] Acquired lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Refreshing network info cache for port 0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:31 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878fc9e-9e20-4667-90e3-2b51c52928ca]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_brick.utils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updating existing volume attachment record: 5c631e1a-a464-4334-bf13-79322e15381d {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb91bee94-c0, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb91bee94-c0, col_values=(('qos', UUID('d921feb5-3f1e-4345-862a-f5b9aa8beae5')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb91bee94-c0, col_values=(('external_ids', {'iface-id': 'b91bee94-c03b-4c39-942a-c69ba5d153a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:79:c5', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0')
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17c1ea23-ddd7-5ece-8671-d1b4cbc3a881', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69282295-ea, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69282295-ea, col_values=(('qos', UUID('b03c3398-7ed4-49ed-81fc-9c71461b07aa')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69282295-ea, col_values=(('external_ids', {'iface-id': '69282295-ea46-4e44-ad8b-baf3afc662ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:e5:e8', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea')
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41549599-b42d-5969-9189-0cd160551e20', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf29296f3-ed, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf29296f3-ed, col_values=(('qos', UUID('39eadd66-6372-45d3-8762-11b14d5201d0')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf29296f3-ed, col_values=(('external_ids', {'iface-id': 'f29296f3-eda1-4039-9561-f5588f663248', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:e6:8b', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed')
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b329435-63b7-594a-8484-6688aa7623b6', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap324667bd-a1, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap324667bd-a1, col_values=(('qos', UUID('43f0b45b-858f-41c0-832c-551c6f9c4356')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap324667bd-a1, col_values=(('external_ids', {'iface-id': '324667bd-a18f-47f9-b0ec-9a3097b915a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:44:5c', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1')
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8407e60f-ea05-5334-a4ea-a3bf68c26002', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-028df134-461a-4d45-b85c-80c6adbe5dc9 req-d5032eb0-3f1b-483f-9081-f4b326246cb3 service nova] Releasing lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquired lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12a0ff8d-85, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12a0ff8d-85, col_values=(('qos', UUID('669e1dac-ba58-4c47-95f5-e0415e93b42c')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12a0ff8d-85, col_values=(('external_ids', {'iface-id': '12a0ff8d-859c-456c-a0de-b437089898d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:4c:38', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85')
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a3af6ba-d13d-5560-896e-c7c2162ca418', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6d71e38-85, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6d71e38-85, col_values=(('qos', UUID('5e9c4077-a4d6-4778-bbd2-8a79d9e96dfe')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6d71e38-85, col_values=(('external_ids', {'iface-id': 'e6d71e38-852a-4c2c-8fb9-5403b0fa30ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:74:a5', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85')
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee25b50f-a22d-55a4-a4a2-a84eaff9d666', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d98b117-d9, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d98b117-d9, col_values=(('qos', UUID('e6cfd34c-3fbf-45a5-9a91-2b7b048711fd')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d98b117-d9, col_values=(('external_ids', {'iface-id': '8d98b117-d9a7-441c-a3b3-7d928bd80eb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:80:e5', 'vm-uuid': '42302861-cfa2-4ee8-a769-d8cd942f44e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: INFO os_vif [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9')
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] No BDM found with device name hda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] No VIF found with MAC fa:16:3e:e5:79:c5, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] No VIF found with MAC fa:16:3e:52:4c:38, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Using config drive
Nov 30 09:15:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Creating config drive at /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/disk.config
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcq8dg916 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcq8dg916" returned: 0 in 0.054s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updating instance_info_cache with network_info: [{"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Updating instance_info_cache with network_info: [{"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-1ba82957-aff8-4c4f-8f7b-1a5c076e124f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Releasing lock "refresh_cache-fc62bd95-5c8b-49e6-b256-d0db7e20f778" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance network_info: |[{"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Start _get_guest_xml network_info=[{"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:15:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1355314172',display_name='tempest-ServersNegativeTestJSON-server-1355314172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1355314172',id=13,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-uf0di8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:15:31Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=fc62bd95-5c8b-49e6-b256-d0db7e20f778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lazy-loading 'pci_devices' on Instance uuid fc62bd95-5c8b-49e6-b256-d0db7e20f778 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:15:32 user nova-compute[75340]:   <uuid>fc62bd95-5c8b-49e6-b256-d0db7e20f778</uuid>
Nov 30 09:15:32 user nova-compute[75340]:   <name>instance-0000000d</name>
Nov 30 09:15:32 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:15:32 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:15:32 user nova-compute[75340]:   <metadata>
Nov 30 09:15:32 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:15:32 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:name>tempest-ServersNegativeTestJSON-server-1355314172</nova:name>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:15:32</nova:creationTime>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:15:32 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:15:32 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:owner>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:user uuid="44ea0b017210427eb36856893f55725e">tempest-ServersNegativeTestJSON-1523211864-project-member</nova:user>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:project uuid="8863798b8e9b48309a3c365ff2ea40f4">tempest-ServersNegativeTestJSON-1523211864</nova:project>
Nov 30 09:15:32 user nova-compute[75340]:       </nova:owner>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:15:32 user nova-compute[75340]:       <nova:ports>
Nov 30 09:15:32 user nova-compute[75340]:         <nova:port uuid="0944cc1e-80be-484d-b85f-8efdc5b9a44c">
Nov 30 09:15:32 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 09:15:32 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:32 user nova-compute[75340]:       </nova:ports>
Nov 30 09:15:32 user nova-compute[75340]:     </nova:instance>
Nov 30 09:15:32 user nova-compute[75340]:   </metadata>
Nov 30 09:15:32 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:15:32 user nova-compute[75340]:     <system>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="serial">fc62bd95-5c8b-49e6-b256-d0db7e20f778</entry>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="uuid">fc62bd95-5c8b-49e6-b256-d0db7e20f778</entry>
Nov 30 09:15:32 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:15:32 user nova-compute[75340]:     </system>
Nov 30 09:15:32 user nova-compute[75340]:   </sysinfo>
Nov 30 09:15:32 user nova-compute[75340]:   <os>
Nov 30 09:15:32 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:15:32 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:15:32 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:15:32 user nova-compute[75340]:   </os>
Nov 30 09:15:32 user nova-compute[75340]:   <features>
Nov 30 09:15:32 user nova-compute[75340]:     <acpi/>
Nov 30 09:15:32 user nova-compute[75340]:     <apic/>
Nov 30 09:15:32 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:15:32 user nova-compute[75340]:   </features>
Nov 30 09:15:32 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:15:32 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:15:32 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:15:32 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:15:32 user nova-compute[75340]:   </clock>
Nov 30 09:15:32 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:15:32 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:15:32 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:15:32 user nova-compute[75340]:   </cpu>
Nov 30 09:15:32 user nova-compute[75340]:   <devices>
Nov 30 09:15:32 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:15:32 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:15:32 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk"/>
Nov 30 09:15:32 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:15:32 user nova-compute[75340]:     </disk>
Nov 30 09:15:32 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:32 user nova-compute[75340]:       <mac address="fa:16:3e:1d:f3:33"/>
Nov 30 09:15:32 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:32 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:32 user nova-compute[75340]:       <target dev="tap0944cc1e-80"/>
Nov 30 09:15:32 user nova-compute[75340]:     </interface>
Nov 30 09:15:32 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:15:32 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/console.log" append="off"/>
Nov 30 09:15:32 user nova-compute[75340]:     </serial>
Nov 30 09:15:32 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:15:32 user nova-compute[75340]:     <video>
Nov 30 09:15:32 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:32 user nova-compute[75340]:     </video>
Nov 30 09:15:32 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:15:32 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:15:32 user nova-compute[75340]:     </rng>
Nov 30 09:15:32 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:15:32 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:15:32 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:15:32 user nova-compute[75340]:     </memballoon>
Nov 30 09:15:32 user nova-compute[75340]:   </devices>
Nov 30 09:15:32 user nova-compute[75340]: </domain>
Nov 30 09:15:32 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1355314172',display_name='tempest-ServersNegativeTestJSON-server-1355314172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1355314172',id=13,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-uf0di8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:15:31Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=fc62bd95-5c8b-49e6-b256-d0db7e20f778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG os_vif [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de06b612-65dd-5d92-8f99-6709290b2dc0', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0944cc1e-80, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0944cc1e-80, col_values=(('qos', UUID('3ff09deb-0047-4c3f-8722-be86a7e18a75')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0944cc1e-80, col_values=(('external_ids', {'iface-id': '0944cc1e-80be-484d-b85f-8efdc5b9a44c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f3:33', 'vm-uuid': 'fc62bd95-5c8b-49e6-b256-d0db7e20f778'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:33 user nova-compute[75340]: INFO os_vif [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80')
Nov 30 09:15:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] No VIF found with MAC fa:16:3e:1d:f3:33, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:35 user nova-compute[75340]: WARNING nova.compute.manager [req-4484cbe7-018f-4155-a66c-906f186fd1d6 req-955a64a9-5192-4e99-b22f-754ec37870a8 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 for instance with vm_state building and task_state spawning.
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-changed-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Refreshing instance network info cache due to event network-changed-41652583-81c1-4a67-b474-8231b70b84aa. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] Acquiring lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] Acquired lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Refreshing network info cache for port 41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: INFO nova.compute.manager [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] instance snapshotting
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Beginning live snapshot process
Nov 30 09:15:36 user nova-compute[75340]: DEBUG nova.network.neutron [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updated VIF entry in instance network info cache for port 41652583-81c1-4a67-b474-8231b70b84aa. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG nova.network.neutron [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating instance_info_cache with network_info: [{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38113d0f-84a1-44c6-8e05-785b834d6875 req-5cafea41-d70d-4d61-8093-21919d370c32 service nova] Releasing lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:36 user nova-compute[75340]: WARNING nova.compute.manager [req-76dc505d-816f-413a-be39-a20fd79dd354 req-3375a10c-192f-4f84-bdd4-2fd96c8e902b service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca for instance with vm_state building and task_state spawning.
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json -f qcow2" returned: 0 in 0.271s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.245s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68.delta 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 for instance with vm_state building and task_state spawning.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] No waiting events found dispatching network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received unexpected event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c for instance with vm_state building and task_state spawning.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] No waiting events found dispatching network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received unexpected event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c for instance with vm_state building and task_state spawning.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 for instance with vm_state building and task_state spawning.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1affe44f-ba55-422f-a817-61ff5fd4a629 req-0c6cd198-9561-40d5-ad56-5e5b6c2f42a6 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 for instance with vm_state building and task_state spawning.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68.delta 1073741824" returned: 0 in 0.076s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 09:15:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75340) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 30 09:15:37 user nova-compute[75340]: INFO nova.virt.libvirt.host [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] UEFI support detected
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:38 user nova-compute[75340]: WARNING nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 for instance with vm_state building and task_state spawning.
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:38 user nova-compute[75340]: WARNING nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 for instance with vm_state building and task_state spawning.
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:38 user nova-compute[75340]: WARNING nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 for instance with vm_state building and task_state spawning.
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:38 user nova-compute[75340]: WARNING nova.compute.manager [req-339f9f92-9c2d-44c3-96b3-44be68c80727 req-b5efc78a-8e87-4217-abd8-f57d509eacfe service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 for instance with vm_state building and task_state spawning.
Nov 30 09:15:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 458752 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:39 user nova-compute[75340]: WARNING nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca for instance with vm_state building and task_state spawning.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-changed-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Refreshing instance network info cache due to event network-changed-4948b73b-dc7f-4720-8006-1232706b4aac. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Refreshing network info cache for port 4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 16580608 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.objects.instance [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:15:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 09:15:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance spawned successfully.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68.delta /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: INFO nova.compute.manager [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Attaching volume 4a0f56ba-7f79-4f48-97b0-80c0876a0087 to /dev/vdb
Nov 30 09:15:39 user nova-compute[75340]: INFO nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Took 9.25 seconds to spawn the instance on the hypervisor.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updated VIF entry in instance network info cache for port 4948b73b-dc7f-4720-8006-1232706b4aac. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:39 user nova-compute[75340]: WARNING nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce for instance with vm_state building and task_state spawning.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:39 user nova-compute[75340]: WARNING nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce for instance with vm_state building and task_state spawning.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:39 user nova-compute[75340]: WARNING nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 for instance with vm_state building and task_state spawning.
Nov 30 09:15:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:40 user nova-compute[75340]: WARNING nova.compute.manager [req-3b776c62-86fe-4931-a48d-44c4bb371b63 req-b2a4c669-0149-4bef-aa6f-434c99ac8587 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 for instance with vm_state building and task_state spawning.
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.utils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7836f-9f11-45c7-9dce-8a3e45712527]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4a396-7565-4533-9151-fd69cc89c830]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d843a-c1f3-4d2f-8ca3-ee0fe92c5c62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9da83a-2979-494e-8a3e-5ba430ac9b89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:15:40 user nova-compute[75340]: INFO nova.compute.manager [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Took 10.44 seconds to build instance.
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:15:40 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca42965-2ce6-455c-a76b-c339a0207131]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG os_brick.utils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== get_connector_properties: return (368ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating existing volume attachment record: 06d16659-31b9-4f52-bd65-0b2c37f9beb0 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0d1a8109-7ae0-4c38-a72b-a5a641f0e73e tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.664s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68.delta /opt/stack/data/nova/instances/snapshots/tmp2_99emjv/f5764b45689a4f1386ee95da063edb68" returned: 0 in 0.798s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Snapshot extracted, beginning image upload
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.459s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:15:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:15:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance spawned successfully.
Nov 30 09:15:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing instance network info cache due to event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.network.neutron [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: INFO nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Took 14.71 seconds to spawn the instance on the hypervisor.
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: INFO nova.compute.manager [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Took 44.59 seconds to build instance.
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mTJEswxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:42 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:42 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:42 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e8504ac5-3a50-4a56-8794-743470f64c6f tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.703s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa58f6f-d081-478f-b82e-3591051c7ce4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:15:42 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3871c75-99f3-498c-aeaa-e749e6bc134c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0] added
Nov 30 09:15:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebaff11-2f02-4d11-b22a-fe3fa75ae6b6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8fb97-463e-4001-97c3-c66db73fdb1a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mTJEswxY {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.network.neutron [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated VIF entry in instance network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG nova.network.neutron [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mTJEswxY" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d252af5b-c7bc-48f6-a8f3-e4bd1369e4d7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mTJEswxY'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f0678b16-f3db-45b8-a603-db6963e436a4 req-53b69fb1-cf30-4c48-8397-f553fa419af6 service nova] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[348381dc-d879-4712-ad85-ed7abe390a89]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fb344-d6e1-42f2-b131-941512d59c43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:42 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:42 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:42 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:42 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02fdc6-d10a-4dff-a96f-50cb82af7325]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260]
Nov 30 09:15:42 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed2243-e54c-4b30-8848-3945f03c017a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdab3d3-ef54-4d04-8d2f-3d33f62fb6a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)
Nov 30 09:15:43 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:43 user nova-compute[75340]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)
Nov 30 09:15:43 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.549s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef4ec1-b113-4804-8e36-730ced60f246]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mTJEswxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.607s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '23065326531623030', 'path': '/dev/sde'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065326531623030', 'path': '/dev/sde'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lazy-loading 'flavor' on Instance uuid 1ba82957-aff8-4c4f-8f7b-1a5c076e124f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:15:44 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:15:44 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:15:44 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:15:44 user nova-compute[75340]:   <serial>e390e081-a067-47e3-9c44-e390a71b55c0</serial>
Nov 30 09:15:44 user nova-compute[75340]: </disk>
Nov 30 09:15:44 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Snapshot image upload complete
Nov 30 09:15:44 user nova-compute[75340]: INFO nova.compute.manager [None req-48928e23-61eb-4aa8-aec6-a5ecfd2294e3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Took 8.11 seconds to snapshot the instance on the hypervisor.
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] No VIF found with MAC fa:16:3e:d0:6a:c4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3f954f33-344d-477a-b8f6-9da22883f047 tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.330s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:15:46 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:46 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=6816MB free_disk=25.545257568359375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:46 user nova-compute[75340]: INFO nova.compute.manager [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Terminating instance
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 1ba82957-aff8-4c4f-8f7b-1a5c076e124f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 30737691-a43b-44ec-93c2-b66868d553ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 983d3252-e5e7-4cfb-aab1-c717c754a700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8737b5bb-6bdb-4293-bae8-3857aded9074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance ef858fe4-a912-4729-9f48-11e473364f13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 42302861-cfa2-4ee8-a769-d8cd942f44e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fc62bd95-5c8b-49e6-b256-d0db7e20f778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-unplugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] No waiting events found dispatching network-vif-unplugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-4576bf1e-2943-476e-910c-7d346037d5e1 req-c4a1222f-5344-4c21-8f42-00a169634f78 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-unplugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Instance destroyed successfully.
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lazy-loading 'resources' on Instance uuid 1ba82957-aff8-4c4f-8f7b-1a5c076e124f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-277982327',display_name='tempest-DeleteServersTestJSON-server-277982327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-277982327',id=2,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ae4d82ae7ff45529e368d1d4eace4ef',ramdisk_id='',reservation_id='r-hkmkit3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-211775344',owner_user_name='tempest-DeleteServersTestJSON-211775344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:13:53Z,user_data=None,user_id='9742c099d4bb4ae2990caaace9e5875d',uuid=1ba82957-aff8-4c4f-8f7b-1a5c076e124f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converting VIF {"id": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "address": "fa:16:3e:d0:6a:c4", "network": {"id": "27354e34-1a6c-4399-94e3-c24ffa2f99d0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610799091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ae4d82ae7ff45529e368d1d4eace4ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03867240-0c", "ovs_interfaceid": "03867240-0cd4-4cfc-be50-f82a6ba87ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_vif [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03867240-0c, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cf0f924-c404-4129-a296-6cde007f6a46) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:47 user nova-compute[75340]: INFO os_vif [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=03867240-0cd4-4cfc-be50-f82a6ba87ac1,network=Network(27354e34-1a6c-4399-94e3-c24ffa2f99d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03867240-0c')
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mTJEswxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:47 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69cf077-5949-47dc-b69a-f069e4db2400]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:15:47 user nova-compute[75340]: No targets found.
Nov 30 09:15:47 user nova-compute[75340]: iSNS:
Nov 30 09:15:47 user nova-compute[75340]: No targets found.
Nov 30 09:15:47 user nova-compute[75340]: STATIC:
Nov 30 09:15:47 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:15:47 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:15:47 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:15:47 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:15:47 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:15:47 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:15:47 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0
Nov 30 09:15:47 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:15:47 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:15:47 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:15:47 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:15:47 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:15:47 user nova-compute[75340]: FIRMWARE:
Nov 30 09:15:47 user nova-compute[75340]: No targets found.
Nov 30 09:15:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:15:47 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:15:47 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a563d76f-a838-4c1b-8ed8-ef1b6c10935f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9402c552-6e7b-47e4-ad65-c31d46d589bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)
Nov 30 09:15:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:47 user nova-compute[75340]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 (non-flash)
Nov 30 09:15:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5014a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0'): ({'sde'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Removing single pathed devices sde {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c007f4-388a-4f1a-ae7d-4c22366eb390]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c03ba18-f6e9-42f5-ad34-1d73811207ff]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Flushing IO for device /dev/sde {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64d405-3a88-4a0c-a7e8-96fedb8ebbe0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0a5e7-bdab-4041-8140-69101b1798d7]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8ffe9-5093-4aeb-8f46-5987e9440130]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdf633d-48e0-4a0f-88f4-df84e3aa4495]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260]
Nov 30 09:15:47 user nova-compute[75340]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e390e081-a067-47e3-9c44-e390a71b55c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0003f4-0001-468e-806d-e9267cffb670]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] <== disconnect_volume: return (336ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:15:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Deleting instance files /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f_del
Nov 30 09:15:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Deletion of /opt/stack/data/nova/instances/1ba82957-aff8-4c4f-8f7b-1a5c076e124f_del complete
Nov 30 09:15:47 user nova-compute[75340]: INFO nova.compute.manager [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 30 09:15:47 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:15:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:48 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Took 0.62 seconds to deallocate network for instance.
Nov 30 09:15:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] Acquiring lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] No waiting events found dispatching network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:15:48 user nova-compute[75340]: WARNING nova.compute.manager [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received unexpected event network-vif-plugged-03867240-0cd4-4cfc-be50-f82a6ba87ac1 for instance with vm_state active and task_state deleting.
Nov 30 09:15:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-3684dc47-ee8a-4a99-a4e2-a06f114b90c9 req-b1968568-44bb-4793-adfe-dfc7701daa48 service nova] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Received event network-vif-deleted-03867240-0cd4-4cfc-be50-f82a6ba87ac1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:51 user nova-compute[75340]: INFO nova.compute.manager [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] [instance: 1ba82957-aff8-4c4f-8f7b-1a5c076e124f] Took 3.21 seconds to detach 1 volumes for instance.
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAfgtFXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:15:51 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:51 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:15:51 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9775048a-08e9-4d5c-9dc8-3277cc05f3ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:15:51 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabcf1b-b90c-477a-9d87-03069970b2e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087] added
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb40ef-45d0-4765-8538-37caf5655332]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6680c1-c2f1-4f14-954a-521bea8a5a99]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAfgtFXm {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAfgtFXm" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb74f9d-418e-4ff2-a08f-fb21d4684951]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAfgtFXm'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4549985-0f10-4b15-b820-eb1b6dc67cbd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080b493-0a39-4873-9557-dd94628bc25e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ea548-04f0-438e-b4e7-91f024b9e1eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260]
Nov 30 09:15:51 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260] successful.
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[df779179-9d1c-4e37-b2eb-a1d71aa3d21d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fde601-77f9-496c-8ed8-f63ed7bafb5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:15:51 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:15:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5440979-33d6-4d27-bd7b-8acc2beabfc4]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAfgtFXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:15:51 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:52 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Deleted allocations for instance 1ba82957-aff8-4c4f-8f7b-1a5c076e124f
Nov 30 09:15:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d41e06f3-d8f3-4cb7-a215-8c27d1e08d8c tempest-DeleteServersTestJSON-211775344 tempest-DeleteServersTestJSON-211775344-project-member] Lock "1ba82957-aff8-4c4f-8f7b-1a5c076e124f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.774s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23033336662313430', 'path': '/dev/sde'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033336662313430', 'path': '/dev/sde'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:15:52 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:15:52 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:15:52 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:15:52 user nova-compute[75340]:   <serial>4a0f56ba-7f79-4f48-97b0-80c0876a0087</serial>
Nov 30 09:15:52 user nova-compute[75340]: </disk>
Nov 30 09:15:52 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:15:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:82:79:c4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-13906a14-4c74-4f32-be94-c13fd06829da tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.535s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:56 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:15:56 user nova-compute[75340]: INFO nova.compute.claims [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Claim successful on node user
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:15:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.policy [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea3a2d5bc1c47ea988021ed23683f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddb2f89853f41d08fbeb37811d9d4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:15:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Creating image(s)
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "/opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk 1073741824" returned: 0 in 0.051s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Successfully created port: 8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:15:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Cannot resize image /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Ensure instance console log exists: /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Successfully updated port: 8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquired lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-changed-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Refreshing instance network info cache due to event network-changed-8e161b24-3561-4bcd-9151-a78d869398d5. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] Acquiring lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updating instance_info_cache with network_info: [{"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Releasing lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Instance network_info: |[{"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] Acquired lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Refreshing network info cache for port 8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Start _get_guest_xml network_info=[{"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:15:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291080789',display_name='tempest-AttachVolumeNegativeTest-server-1291080789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291080789',id=14,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfhcMwcJh8Pw7I94Enej1RQahWuUgh5Ti1CESMyb5C2isTu+A5/iFEUJCadZj0jC0uu9pc8Nt6X1QyVIDQVmRDd6yZbPEXxWJ61QMgwqR7JcYYl5YDmtVHZWtBfnsmszg==',key_name='tempest-keypair-190703243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-ehbdj1ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=9df69524-d3db-4d24-aaa4-f08efdf7c7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.objects.instance [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df69524-d3db-4d24-aaa4-f08efdf7c7a6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:15:58 user nova-compute[75340]:   <uuid>9df69524-d3db-4d24-aaa4-f08efdf7c7a6</uuid>
Nov 30 09:15:58 user nova-compute[75340]:   <name>instance-0000000e</name>
Nov 30 09:15:58 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:15:58 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:15:58 user nova-compute[75340]:   <metadata>
Nov 30 09:15:58 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:15:58 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1291080789</nova:name>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:15:58</nova:creationTime>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:15:58 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:15:58 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:owner>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:user uuid="fea3a2d5bc1c47ea988021ed23683f08">tempest-AttachVolumeNegativeTest-689840258-project-member</nova:user>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:project uuid="4ddb2f89853f41d08fbeb37811d9d4e8">tempest-AttachVolumeNegativeTest-689840258</nova:project>
Nov 30 09:15:58 user nova-compute[75340]:       </nova:owner>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:15:58 user nova-compute[75340]:       <nova:ports>
Nov 30 09:15:58 user nova-compute[75340]:         <nova:port uuid="8e161b24-3561-4bcd-9151-a78d869398d5">
Nov 30 09:15:58 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:15:58 user nova-compute[75340]:         </nova:port>
Nov 30 09:15:58 user nova-compute[75340]:       </nova:ports>
Nov 30 09:15:58 user nova-compute[75340]:     </nova:instance>
Nov 30 09:15:58 user nova-compute[75340]:   </metadata>
Nov 30 09:15:58 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:15:58 user nova-compute[75340]:     <system>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="serial">9df69524-d3db-4d24-aaa4-f08efdf7c7a6</entry>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="uuid">9df69524-d3db-4d24-aaa4-f08efdf7c7a6</entry>
Nov 30 09:15:58 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:15:58 user nova-compute[75340]:     </system>
Nov 30 09:15:58 user nova-compute[75340]:   </sysinfo>
Nov 30 09:15:58 user nova-compute[75340]:   <os>
Nov 30 09:15:58 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:15:58 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:15:58 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:15:58 user nova-compute[75340]:   </os>
Nov 30 09:15:58 user nova-compute[75340]:   <features>
Nov 30 09:15:58 user nova-compute[75340]:     <acpi/>
Nov 30 09:15:58 user nova-compute[75340]:     <apic/>
Nov 30 09:15:58 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:15:58 user nova-compute[75340]:   </features>
Nov 30 09:15:58 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:15:58 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:15:58 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:15:58 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:15:58 user nova-compute[75340]:   </clock>
Nov 30 09:15:58 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:15:58 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:15:58 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:15:58 user nova-compute[75340]:   </cpu>
Nov 30 09:15:58 user nova-compute[75340]:   <devices>
Nov 30 09:15:58 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:15:58 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:15:58 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk"/>
Nov 30 09:15:58 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:15:58 user nova-compute[75340]:     </disk>
Nov 30 09:15:58 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:15:58 user nova-compute[75340]:       <mac address="fa:16:3e:40:8c:75"/>
Nov 30 09:15:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:58 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:15:58 user nova-compute[75340]:       <target dev="tap8e161b24-35"/>
Nov 30 09:15:58 user nova-compute[75340]:     </interface>
Nov 30 09:15:58 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:15:58 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/console.log" append="off"/>
Nov 30 09:15:58 user nova-compute[75340]:     </serial>
Nov 30 09:15:58 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:15:58 user nova-compute[75340]:     <video>
Nov 30 09:15:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:15:58 user nova-compute[75340]:     </video>
Nov 30 09:15:58 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:15:58 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:15:58 user nova-compute[75340]:     </rng>
Nov 30 09:15:58 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:15:58 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:15:58 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:15:58 user nova-compute[75340]:     </memballoon>
Nov 30 09:15:58 user nova-compute[75340]:   </devices>
Nov 30 09:15:58 user nova-compute[75340]: </domain>
Nov 30 09:15:58 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291080789',display_name='tempest-AttachVolumeNegativeTest-server-1291080789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291080789',id=14,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfhcMwcJh8Pw7I94Enej1RQahWuUgh5Ti1CESMyb5C2isTu+A5/iFEUJCadZj0jC0uu9pc8Nt6X1QyVIDQVmRDd6yZbPEXxWJ61QMgwqR7JcYYl5YDmtVHZWtBfnsmszg==',key_name='tempest-keypair-190703243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-ehbdj1ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=9df69524-d3db-4d24-aaa4-f08efdf7c7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG os_vif [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86aa7d91-bcab-5641-82e1-6173df885737', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e161b24-35, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e161b24-35, col_values=(('qos', UUID('cc444c17-b5f9-4eef-85c6-2ca7028b04f1')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e161b24-35, col_values=(('external_ids', {'iface-id': '8e161b24-3561-4bcd-9151-a78d869398d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:8c:75', 'vm-uuid': '9df69524-d3db-4d24-aaa4-f08efdf7c7a6'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:15:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:15:58 user nova-compute[75340]: INFO os_vif [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35')
Nov 30 09:15:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:15:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:40:8c:75, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:15:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updated VIF entry in instance network info cache for port 8e161b24-3561-4bcd-9151-a78d869398d5. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:15:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updating instance_info_cache with network_info: [{"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:15:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2e03b2f-7d9d-4287-b624-83a0023a4a19 req-0a168506-5c85-40ef-ab09-46e1c3e25b59 service nova] Releasing lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-changed-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Refreshing instance network info cache due to event network-changed-ffd3921c-2171-4680-aec2-ad94ad431420. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] Acquiring lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] Acquired lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:00 user nova-compute[75340]: DEBUG nova.network.neutron [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Refreshing network info cache for port ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updated VIF entry in instance network info cache for port ffd3921c-2171-4680-aec2-ad94ad431420. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updating instance_info_cache with network_info: [{"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-831d06a1-82b5-4932-a1f4-14cefd7adaa7 req-349cb3f9-bd09-43c1-a568-790f8c5fc00c service nova] Releasing lock "refresh_cache-983d3252-e5e7-4cfb-aab1-c717c754a700" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-changed-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Refreshing instance network info cache due to event network-changed-8ba14a9a-668f-409f-9cfd-de357918856b. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] Acquiring lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] Acquired lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Refreshing network info cache for port 8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updated VIF entry in instance network info cache for port 8ba14a9a-668f-409f-9cfd-de357918856b. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updating instance_info_cache with network_info: [{"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c86a7bf-5a56-468c-b090-14db7084eeb8 req-740be2a3-4791-4e71-89ab-ec6cfec69257 service nova] Releasing lock "refresh_cache-b2d40060-d7cc-4038-9f91-8551ba7576f9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] No waiting events found dispatching network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:02 user nova-compute[75340]: WARNING nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received unexpected event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 for instance with vm_state building and task_state spawning.
Nov 30 09:16:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] No waiting events found dispatching network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:02 user nova-compute[75340]: WARNING nova.compute.manager [req-1eb6da4d-cea1-4ea2-a444-0d1f846857be req-01ba647a-633a-4177-bf4f-e5cfe0914136 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received unexpected event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 for instance with vm_state building and task_state spawning.
Nov 30 09:16:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:16:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Instance spawned successfully.
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:16:03 user nova-compute[75340]: INFO nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 30 09:16:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:16:03 user nova-compute[75340]: INFO nova.compute.manager [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Took 7.25 seconds to build instance.
Nov 30 09:16:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-32bf5813-5e69-4c4a-b649-5fcccdfa0b7e tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.346s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'flavor' on Instance uuid b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lazy-loading 'flavor' on Instance uuid 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:04 user nova-compute[75340]: INFO nova.compute.manager [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Attaching volume 7259fb67-a363-424e-819e-7fcc69937079 to /dev/vdb
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-changed-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing instance network info cache due to event network-changed-9ec18e6c-a83d-430b-bf00-0719c095b253. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing network info cache for port 9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:04 user nova-compute[75340]: INFO nova.compute.manager [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Attaching volume 4d39a3d5-ea22-42f2-9059-a3d3b872167a to /dev/sdc
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.utils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6b2bd6-ddbf-4c2b-806a-f8a62d8d789f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101b0bf-94ce-4b23-8fa0-029bb62e3873]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.utils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf9cce0-4085-4565-b199-ac6080f1efbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b55cdb-e8f1-40c2-bb3d-5a77e7b0089c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55bf8a4-64a4-4c01-ac09-1a94b844aa37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:04 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d3857-3f5f-4142-8f97-be36e06b109d]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.utils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updating existing volume attachment record: 64df2e8c-3527-46fb-af9e-ae9fd5c3dc07 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc040f09-d2ed-4428-af7a-fb695563b3be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be0f4b-a232-4655-ab32-57a78f676e33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c62d50f-543a-4c74-b3a2-11d64bc89e95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:05 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161bed4-0940-4b5d-8496-196def9f954e]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG os_brick.utils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updating existing volume attachment record: 3198dc8f-a27a-46ed-8d96-d9cc25f4e46b {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'flavor' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.compute.manager [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-changed-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.compute.manager [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Refreshing instance network info cache due to event network-changed-4d07b2b8-9b11-4908-9f55-71ee0996123f. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] Acquiring lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] Acquired lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Refreshing network info cache for port 4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lazy-loading 'flavor' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updated VIF entry in instance network info cache for port 9ec18e6c-a83d-430b-bf00-0719c095b253. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'pci_requests' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.objects.base [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Object Instance<8737b5bb-6bdb-4293-bae8-3857aded9074> lazy-loaded attributes: flavor,pci_requests {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4ae8336-e9b8-49a8-876c-94c724d3691b req-0183cd6a-731e-484e-be78-1cbd2bbb1058 service nova] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.policy [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ee8b1b90db42768cc3ee61d1454f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ec812897b740438e7f8c6aaf1f245c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:05 user nova-compute[75340]: INFO nova.compute.manager [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attaching volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b to /dev/vdb
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updated VIF entry in instance network info cache for port 4d07b2b8-9b11-4908-9f55-71ee0996123f. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG nova.network.neutron [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updating instance_info_cache with network_info: [{"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6bb837e1-0993-4b93-8032-ee654d93b167 req-dece8c45-ce77-4016-81d8-213d650358cd service nova] Releasing lock "refresh_cache-ef858fe4-a912-4729-9f48-11e473364f13" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.utils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ede95-4726-4c53-89d6-e7d58ee285e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[513be00b-26de-4f1b-b1b3-376bbe2297cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[560d5e2a-5cee-4d1f-9d42-e640380f24dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e665e0-fb0f-4c19-85f3-6d296824ec13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:06 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d802a-311f-4253-8182-d40bf9ed9b2e]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG os_brick.utils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updating existing volume attachment record: 29554073-3815-470d-9ad2-c0735dfedf77 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Successfully created port: f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Successfully updated port: f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-changed-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing instance network info cache due to event network-changed-f71c5627-2342-4438-b804-028e19d9fd25. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Refreshing network info cache for port f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG os_vif [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac19fa37-ef76-53e8-8d65-0adc639f395d', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf71c5627-23, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf71c5627-23, col_values=(('qos', UUID('fe35cfdf-e4ce-4a46-936c-9d6795cac312')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf71c5627-23, col_values=(('external_ids', {'iface-id': 'f71c5627-2342-4438-b804-028e19d9fd25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:31:09', 'vm-uuid': '8737b5bb-6bdb-4293-bae8-3857aded9074'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:07 user nova-compute[75340]: INFO os_vif [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23')
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] attach device xml: <interface type="ethernet">
Nov 30 09:16:07 user nova-compute[75340]:   <mac address="fa:16:3e:76:31:09"/>
Nov 30 09:16:07 user nova-compute[75340]:   <model type="virtio"/>
Nov 30 09:16:07 user nova-compute[75340]:   <mtu size="1442"/>
Nov 30 09:16:07 user nova-compute[75340]:   <target dev="tapf71c5627-23"/>
Nov 30 09:16:07 user nova-compute[75340]: </interface>
Nov 30 09:16:07 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:08 user nova-compute[75340]: WARNING nova.compute.manager [req-4552cc8a-ed8d-46e0-9d11-f6f31b209e93 req-18e08ab1-72cc-4aba-af56-91bb91747e1e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 for instance with vm_state active and task_state None.
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.network.neutron [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updated VIF entry in instance network info cache for port f71c5627-2342-4438-b804-028e19d9fd25. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.network.neutron [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No VIF found with MAC fa:16:3e:b5:e3:d1, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41140a2f-eb1f-49c2-af0f-4f9592fce6c1 req-c6dd230c-bc2a-47eb-a689-f86ffd242850 service nova] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:16:08 user nova-compute[75340]:   <nova:package version="0.0.0"/>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:name>tempest-device-tagging-server-2065242471</nova:name>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:creationTime>2023-11-30 09:16:08</nova:creationTime>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:flavor name="m1.tiny">
Nov 30 09:16:08 user nova-compute[75340]:     <nova:memory>512</nova:memory>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:disk>1</nova:disk>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:swap>0</nova:swap>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:vcpus>1</nova:vcpus>
Nov 30 09:16:08 user nova-compute[75340]:   </nova:flavor>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:owner>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:user uuid="94ee8b1b90db42768cc3ee61d1454f58">tempest-TaggedAttachmentsTest-716106286-project-member</nova:user>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:project uuid="e4ec812897b740438e7f8c6aaf1f245c">tempest-TaggedAttachmentsTest-716106286</nova:project>
Nov 30 09:16:08 user nova-compute[75340]:   </nova:owner>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:16:08 user nova-compute[75340]:   <nova:ports>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:port uuid="9ec18e6c-a83d-430b-bf00-0719c095b253">
Nov 30 09:16:08 user nova-compute[75340]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:16:08 user nova-compute[75340]:     </nova:port>
Nov 30 09:16:08 user nova-compute[75340]:     <nova:port uuid="f71c5627-2342-4438-b804-028e19d9fd25">
Nov 30 09:16:08 user nova-compute[75340]:       <nova:ip type="fixed" address="10.10.10.59" ipVersion="4"/>
Nov 30 09:16:08 user nova-compute[75340]:     </nova:port>
Nov 30 09:16:08 user nova-compute[75340]:   </nova:ports>
Nov 30 09:16:08 user nova-compute[75340]: </nova:instance>
Nov 30 09:16:08 user nova-compute[75340]:  {{(pid=75340) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b4cfbf03-4078-4d20-8297-35b72204c59c tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.551s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:10 user nova-compute[75340]: WARNING nova.compute.manager [req-d48391bc-a000-4c37-8382-dc73d5e6e732 req-5aa1d6e8-172d-40e1-8e27-0eeaa77a9ed6 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 for instance with vm_state active and task_state None.
Nov 30 09:16:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-changed-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Refreshing instance network info cache due to event network-changed-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] Acquiring lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] Acquired lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Refreshing network info cache for port 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updated VIF entry in instance network info cache for port 64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updating instance_info_cache with network_info: [{"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ce4b9ba2-0c9e-4e30-9256-2b33e8b82eb5 req-5460d709-bb6d-46dd-b6fb-b00355db8d6b service nova] Releasing lock "refresh_cache-96cb8988-b8a9-46f8-903a-29f26dfaba1c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTROxkaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:14 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6aaff2-c01b-411d-8684-fa1487d8fa06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:14 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02556e-0de5-46d4-a57e-cfa3c9f971c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079] added
Nov 30 09:16:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[823ac1de-882b-4465-a5e4-4a4c55af236c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4fd3b-69b9-4df0-9598-391cb81ed285]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTROxkaC {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTROxkaC" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff73640-d286-4318-9381-863203dbb06d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eTROxkaC'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51bd2e-3c2b-415a-9bfa-eec00dc90a45]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[019cb59a-e435-4abd-b0aa-00f94db7e13c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:14 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'flavor' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b7d1f-06f1-4764-b357-0559e7dae16f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260]
Nov 30 09:16:15 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1723af-f77a-430b-b41e-4324cfa13afc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lazy-loading 'flavor' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[573af7cf-8f17-4c7a-a364-cac0f92fcf8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[015588b7-4038-43db-9b2b-8746eaedff8c]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTROxkaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLImAvur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:15 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:15 user nova-compute[75340]: INFO nova.compute.manager [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Attaching volume 927d5ac9-91b2-4862-8ff8-2b7933ea12aa to /dev/vdb
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:15 user nova-compute[75340]: INFO nova.compute.manager [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Attaching volume 5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 to /dev/vdb
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.utils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ecef8f-41a2-426c-bfc8-580ba145cd22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be636d-53b9-46b3-b818-47e9da4ba690]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.utils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4f872-cb18-4515-838c-6526ba773c8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdb9bd6-1cf0-438b-a295-5c84f3e64928]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a767e2-3c11-457d-8a63-0a6e895932e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:15 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d113ca-8f42-43d8-bd5d-4f47143c36e8]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.utils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating existing volume attachment record: 9f4f3411-f761-4f49-a36b-7b22a01a75dc {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb7e9b9-0c59-4bf2-8c36-c144a296c423]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b7309-1f1e-467f-b8db-8dee86435211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6734590-ee5e-4889-a7f1-34fde2600479]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:15 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c88daf-34fc-4fa7-a95a-c19836b2e9e6]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG os_brick.utils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:15 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updating existing volume attachment record: 30e008ff-22a1-403b-9012-295f25d66cdd {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23763613931376264', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763613931376264', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.950s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:16 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:16 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'flavor' on Instance uuid b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e547643-e75a-417f-b7c4-aefd0a2d404c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:16 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:16:16 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:16 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:16:16 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:16 user nova-compute[75340]:   <serial>7259fb67-a363-424e-819e-7fcc69937079</serial>
Nov 30 09:16:16 user nova-compute[75340]: </disk>
Nov 30 09:16:16 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6465be7-8cca-4460-ac46-c84cfb99a9f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a] added
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8d0ff4-a936-4ca9-bdcf-099a5a3a3c67]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad4590-be8d-4551-8e92-4ae258bf0e6a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLImAvur {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLImAvur" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1190d2e4-960f-4bae-86fb-b8269a3924da]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLImAvur'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f4af51-57c1-41f1-b172-cd93693f6296]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb04237-d985-4049-9757-68c8a8fae137]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:16 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76142227-ed69-4833-ac5d-09e5ee17974b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260]
Nov 30 09:16:16 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6513a1e1-4b03-4480-b5ff-dd9a5d18566c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae2f20-3193-4349-85d3-0960c9b6ac3b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:16 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555442d-4004-4561-bbed-0e3f6e219d06]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLImAvur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No VIF found with MAC fa:16:3e:c1:19:91, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79017747-2037-437e-a6bb-205576d1db3d tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.196s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] <== connect_volume: return (2342ms) {'type': 'block', 'scsi_wwn': '23162356130623063', 'path': '/dev/sdg'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162356130623063', 'path': '/dev/sdg'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.143s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:17 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lazy-loading 'flavor' on Instance uuid 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cf85e-dd64-4196-8329-35f59fa3ad25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:17 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[80261bd1-5cfb-4c5c-9eca-e06fcfd6353c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b] added
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:16:17 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:17 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:16:17 user nova-compute[75340]:   <target dev="sdc" bus="scsi"/>
Nov 30 09:16:17 user nova-compute[75340]:   <serial>4d39a3d5-ea22-42f2-9059-a3d3b872167a</serial>
Nov 30 09:16:17 user nova-compute[75340]:   <address type="drive" controller="0" unit="2"/>
Nov 30 09:16:17 user nova-compute[75340]: </disk>
Nov 30 09:16:17 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abdac5-ad10-47bb-b545-30ff233e93dd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd3ddf-c2b5-4ecc-a3c3-257971461fc0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmoMVRA {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmoMVRA" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[851613d6-1407-4dbd-98e7-dec6533c557e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJmoMVRA'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0296184f-b72f-4176-9e7e-f9abcbb98501]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a96e072-6e1b-4090-9494-9dfc9a10fbcd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[001de758-978e-45a3-b1e0-73841109f353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]
Nov 30 09:16:17 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194ec6a-c9b4-4873-ad1f-ef12d48ad069]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[db25199d-4cf3-4f1b-ac72-51b138ce70e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:17 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e65313-715f-4fd7-81e8-5727ad1807ff]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No BDM found with device name sda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] No VIF found with MAC fa:16:3e:83:5c:9c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:18 user nova-compute[75340]: INFO nova.compute.manager [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Detaching volume 7259fb67-a363-424e-819e-7fcc69937079
Nov 30 09:16:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a51a10cd-df6b-4bd7-9e79-5121a81a0a10 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.602s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:18 user nova-compute[75340]: INFO nova.virt.block_device [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Attempting to driver detach volume 7259fb67-a363-424e-819e-7fcc69937079 from mountpoint /dev/vdb
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Attempting to detach device vdb from instance b2d40060-d7cc-4038-9f91-8551ba7576f9 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:18 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:18 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:16:18 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:18 user nova-compute[75340]:   <serial>7259fb67-a363-424e-819e-7fcc69937079</serial>
Nov 30 09:16:18 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:18 user nova-compute[75340]: </disk>
Nov 30 09:16:18 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully detached device vdb from instance b2d40060-d7cc-4038-9f91-8551ba7576f9 from the persistent domain config.
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2d40060-d7cc-4038-9f91-8551ba7576f9 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:18 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:18 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:16:18 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:18 user nova-compute[75340]:   <serial>7259fb67-a363-424e-819e-7fcc69937079</serial>
Nov 30 09:16:18 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:18 user nova-compute[75340]: </disk>
Nov 30 09:16:18 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] <== connect_volume: return (2551ms) {'type': 'block', 'scsi_wwn': '23536383139613661', 'path': '/dev/sdh'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536383139613661', 'path': '/dev/sdh'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lazy-loading 'flavor' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:16:19 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:19 user nova-compute[75340]:   <source dev="/dev/sdh"/>
Nov 30 09:16:19 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:19 user nova-compute[75340]:   <serial>49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b</serial>
Nov 30 09:16:19 user nova-compute[75340]: </disk>
Nov 30 09:16:19 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:19 user nova-compute[75340]: INFO nova.compute.manager [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Detaching volume 4d39a3d5-ea22-42f2-9059-a3d3b872167a
Nov 30 09:16:19 user nova-compute[75340]: INFO nova.virt.block_device [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Attempting to driver detach volume 4d39a3d5-ea22-42f2-9059-a3d3b872167a from mountpoint /dev/sdc
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Attempting to detach device sdc from instance 983d3252-e5e7-4cfb-aab1-c717c754a700 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:19 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:19 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:16:19 user nova-compute[75340]:   <target dev="sdc" bus="scsi"/>
Nov 30 09:16:19 user nova-compute[75340]:   <serial>4d39a3d5-ea22-42f2-9059-a3d3b872167a</serial>
Nov 30 09:16:19 user nova-compute[75340]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 09:16:19 user nova-compute[75340]: </disk>
Nov 30 09:16:19 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:19 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Successfully detached device sdc from instance 983d3252-e5e7-4cfb-aab1-c717c754a700 from the persistent domain config.
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 983d3252-e5e7-4cfb-aab1-c717c754a700 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:19 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:19 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:16:19 user nova-compute[75340]:   <target dev="sdc" bus="scsi"/>
Nov 30 09:16:19 user nova-compute[75340]:   <serial>4d39a3d5-ea22-42f2-9059-a3d3b872167a</serial>
Nov 30 09:16:19 user nova-compute[75340]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 09:16:19 user nova-compute[75340]: </disk>
Nov 30 09:16:19 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] No VIF found with MAC fa:16:3e:e4:25:4f, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a55e56c7-41f7-4257-84d3-f0c8ebfef0c2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.729s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.utils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96c2e1-ec7f-4b6b-95c9-bdc41d8f1715]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba90787-7433-4498-aca2-5fae26dfeef9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dffd1b-ee3c-41d0-bacb-11703d5d00b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[854dd095-0c03-4c1f-a528-c141bd037195]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:20 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52d701-526c-4fc6-acae-1b1ba15ef67f]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:20 user nova-compute[75340]: DEBUG os_brick.utils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:20 user nova-compute[75340]: INFO nova.compute.manager [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Swapping volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b for 79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUXdSixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:25 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:25 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:25 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11feff8e-ec89-4210-9aee-1383a2ee9cb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:25 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6dea5b-8e34-4165-bc86-ceb0f4479de4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290] added
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077a64c-4ffd-48a9-8024-509d86b74e8d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a436f61-daac-4ae7-928c-e0ec3cd863e9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUXdSixr {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUXdSixr" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c0cf5-ce3f-47bb-b983-a8b15e0fc029]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUXdSixr'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70204592-c5f1-4424-9774-5d659e3f841e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5753cf-72a6-4d88-a6aa-8da008a62793]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7717cf8-d968-4005-9e79-ff4eadfd9306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260]
Nov 30 09:16:25 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e334a22-9943-4859-a839-51c504a20136]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa92996-c79a-4052-9534-72d8862e0217]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:25 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfnPkipZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:25 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f66e09-286b-435b-9299-6abcd94792b5]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUXdSixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26632663034323231', 'path': '/dev/sdi'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663034323231', 'path': '/dev/sdi'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.029s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:26 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:26 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG nova.objects.instance [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lazy-loading 'flavor' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb41bf8-d8c4-4b1a-a605-0ce13f80e0df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:26 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49e979-39ac-447a-bb60-48bd076f4088]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa] added
Nov 30 09:16:26 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] attach device xml: <disk type="block" device="disk">
Nov 30 09:16:26 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:26 user nova-compute[75340]:   <source dev="/dev/sdi"/>
Nov 30 09:16:26 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:26 user nova-compute[75340]:   <serial>5e9ba433-2a8c-4fbe-91a2-ff0d8db48290</serial>
Nov 30 09:16:26 user nova-compute[75340]: </disk>
Nov 30 09:16:26 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f399f4-d2af-4853-bd7f-962df128af71]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d67a04-51a2-4b85-993f-75c00e2b39fa]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfnPkipZ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfnPkipZ" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6846c6-1a4d-4177-8dd7-386ec97cf466]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bfnPkipZ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50ec1a-af7a-4801-85e7-0b6fc927467d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ed973-b5cf-4934-8f03-2d5a444361dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[921fa01d-4682-43a8-8b3a-25ade3087712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260]
Nov 30 09:16:27 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed8e02-9eb4-4c0a-bb0f-d7982dde3c2a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[365d8555-e14c-4a41-bef8-032ea397e77c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:27 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[61feedb2-5d72-4e9e-9e99-505fdd781688]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] No VIF found with MAC fa:16:3e:aa:22:d5, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-792727b7-399d-4b23-9019-50c74d727a9f tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.148s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] volume_snapshot_create: create_info: {'snapshot_id': '19cab324-70e0-47bd-b2d9-d3af6d5ab5cf', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75340) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] snap xml: <domainsnapshot>
Nov 30 09:16:27 user nova-compute[75340]:   <disks>
Nov 30 09:16:27 user nova-compute[75340]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 30 09:16:27 user nova-compute[75340]:       <source file="/dev/new_file"/>
Nov 30 09:16:27 user nova-compute[75340]:     </disk>
Nov 30 09:16:27 user nova-compute[75340]:     <disk name="vda" snapshot="no"/>
Nov 30 09:16:27 user nova-compute[75340]:   </disks>
Nov 30 09:16:27 user nova-compute[75340]: </domainsnapshot>
Nov 30 09:16:27 user nova-compute[75340]:  {{(pid=75340) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 30 09:16:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] Lazy-loading 'system_metadata' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dfa5e90a-3fc4-4d1f-88fd-340037a5a529 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] volume_snapshot_delete: delete_info: {'volume_id': '5e9ba433-2a8c-4fbe-91a2-ff0d8db48290'} {{(pid=75340) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [None req-dfa5e90a-3fc4-4d1f-88fd-340037a5a529 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     if delete_info['type'] != 'qcow2':
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] KeyError: 'type'
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     rv = execute(f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     six.reraise(c, e, tb)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     raise value
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     rv = meth(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     self._volume_snapshot_create(context, instance, guest,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     rv = execute(f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     six.reraise(c, e, tb)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     raise value
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     rv = meth(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] 
Nov 30 09:16:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [None req-dfa5e90a-3fc4-4d1f-88fd-340037a5a529 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7128cd6d-c60f-418d-bdd0-ceab39cf0933)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server [None req-dfa5e90a-3fc4-4d1f-88fd-340037a5a529 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] Exception during message handling: KeyError: 'type'
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 19cab324-70e0-47bd-b2d9-d3af6d5ab5cf could not be found.
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise value
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 19cab324-70e0-47bd-b2d9-d3af6d5ab5cf could not be found. (HTTP 404) (Request-ID: req-97f86ff8-e603-4054-b7ba-3ae8660f00df)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 19cab324-70e0-47bd-b2d9-d3af6d5ab5cf could not be found.
Nov 30 09:16:28 user nova-compute[75340]: ERROR nova.virt.libvirt.driver 
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server [None req-07632ce5-dab3-4583-9748-69feaaa7c761 tempest-VolumesAssistedSnapshotsTest-2027695955 tempest-VolumesAssistedSnapshotsTest-2027695955-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise value
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 09:16:28 user nova-compute[75340]: ERROR oslo_messaging.rpc.server 
Nov 30 09:16:28 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfnPkipZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] <== connect_volume: return (2403ms) {'type': 'block', 'scsi_wwn': '23933643130623031', 'path': '/dev/sdj'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643130623031', 'path': '/dev/sdj'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'flavor' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:16:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:28 user nova-compute[75340]:   <source dev="/dev/sdj"/>
Nov 30 09:16:28 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:28 user nova-compute[75340]:   <serial>927d5ac9-91b2-4862-8ff8-2b7933ea12aa</serial>
Nov 30 09:16:28 user nova-compute[75340]: </disk>
Nov 30 09:16:28 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:28 user nova-compute[75340]: INFO nova.compute.manager [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Detaching volume 5e9ba433-2a8c-4fbe-91a2-ff0d8db48290
Nov 30 09:16:28 user nova-compute[75340]: INFO nova.virt.block_device [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Attempting to driver detach volume 5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 from mountpoint /dev/vdb
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Attempting to detach device vdb from instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:28 user nova-compute[75340]:   <source dev="/dev/sdi"/>
Nov 30 09:16:28 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:28 user nova-compute[75340]:   <serial>5e9ba433-2a8c-4fbe-91a2-ff0d8db48290</serial>
Nov 30 09:16:28 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:28 user nova-compute[75340]: </disk>
Nov 30 09:16:28 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Successfully detached device vdb from instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c from the persistent domain config.
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:28 user nova-compute[75340]:   <source dev="/dev/sdi"/>
Nov 30 09:16:28 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:28 user nova-compute[75340]:   <serial>5e9ba433-2a8c-4fbe-91a2-ff0d8db48290</serial>
Nov 30 09:16:28 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:28 user nova-compute[75340]: </disk>
Nov 30 09:16:28 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] No VIF found with MAC fa:16:3e:b5:e3:d1, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9903ff7c-a9e4-49d5-b66f-0d8414ecbccc tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.575s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:30 user nova-compute[75340]: INFO nova.compute.manager [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Detaching volume 927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'serial': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'serial'} {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:30 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:30 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:30 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[415a0313-df77-4144-8ff6-3f0a01d5c597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:30 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0f862-384e-4344-bc23-bcc06cdbe0b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc] added
Nov 30 09:16:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: INFO nova.virt.block_device [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Attempting to driver detach volume 927d5ac9-91b2-4862-8ff8-2b7933ea12aa from mountpoint /dev/vdb
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Attempting to detach device vdb from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:30 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:30 user nova-compute[75340]:   <source dev="/dev/sdj"/>
Nov 30 09:16:30 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:30 user nova-compute[75340]:   <serial>927d5ac9-91b2-4862-8ff8-2b7933ea12aa</serial>
Nov 30 09:16:30 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:16:30 user nova-compute[75340]: </disk>
Nov 30 09:16:30 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2179d5ef-d28b-4b95-abd0-8552d9d89786]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully detached device vdb from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the persistent domain config.
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:30 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:30 user nova-compute[75340]:   <source dev="/dev/sdj"/>
Nov 30 09:16:30 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:30 user nova-compute[75340]:   <serial>927d5ac9-91b2-4862-8ff8-2b7933ea12aa</serial>
Nov 30 09:16:30 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:16:30 user nova-compute[75340]: </disk>
Nov 30 09:16:30 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f96654-b0ac-4d85-9060-ee7222f1a8a4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEMmZSAR {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEMmZSAR" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d69ef4-2c87-4fe0-a091-7f56d4a778d0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KEMmZSAR'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0a592-2d62-4030-be4a-c34afae98ee6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[693057f5-c760-4f96-b54d-b663675c9bf9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:30 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b3cb2-cc4d-4ee2-aba4-f64dcad5a013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260]
Nov 30 09:16:30 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f41d7-15c8-488e-9790-3d1f79de6382]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01474a-baaa-4c66-9640-375dcd51073c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:31 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc5547-f345-49df-b9c7-f23f8d68b490]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26233376263336431', 'path': '/dev/sdk'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233376263336431', 'path': '/dev/sdk'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lazy-loading 'flavor' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:16:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 204472320 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 514850816 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:34 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 975175680 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:16:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b7b7d-0ef9-475f-b5c3-701075b4c873]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:37 user nova-compute[75340]: No targets found.
Nov 30 09:16:37 user nova-compute[75340]: iSNS:
Nov 30 09:16:37 user nova-compute[75340]: No targets found.
Nov 30 09:16:37 user nova-compute[75340]: STATIC:
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:37 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:37 user nova-compute[75340]: No targets found.
Nov 30 09:16:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:37 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:37 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00a1153-4120-45ca-919c-09be87b7b939]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14e1ce-14ef-4004-8899-8cb84e38f20b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:37 user nova-compute[75340]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50148550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b'): ({'sdh'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Removing single pathed devices sdh {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419eaec-6d46-4c05-8d88-3cf0e4c67d75]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[344173a3-c3d6-4710-acdf-9322934f74a0]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Flushing IO for device /dev/sdh {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f27c4fd-c837-4b7f-9f29-cc5573091981]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abec4bf-ae2f-4837-8712-96ec9040c774]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] SCSI volumes sdh have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae921a89-08b2-4cea-92b2-1d06e449d16e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda10454-381a-4b3e-941e-83f3efcd4691]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]
Nov 30 09:16:37 user nova-compute[75340]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d4f412-0a41-4c8e-ab3b-305c2a41cd32]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== disconnect_volume: return (382ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'serial'} {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: removing Cinder connection for volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: Updating volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KEMmZSAR", "auth_password": "BGrC7PhaHp2fY9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "79ab4fbb-5fb3-49db-9e77-0d29c149dbcc"}, "status": "reserved", "instance": "ef858fe4-a912-4729-9f48-11e473364f13", "attached_at": "", "detached_at": "", "volume_id": "79ab4fbb-5fb3-49db-9e77-0d29c149dbcc", "serial": "79ab4fbb-5fb3-49db-9e77-0d29c149dbcc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'no_device': None, 'attachment_id': '47523e6f-87e2-4b05-82f7-a2d0640a589c'} {{(pid=75340) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72af2f2b-fa2b-4350-9836-ef52733a1841 tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.209s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2d40060-d7cc-4038-9f91-8551ba7576f9 is timed out.
Nov 30 09:16:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully detached device vdb from instance b2d40060-d7cc-4038-9f91-8551ba7576f9 from the live domain config.
Nov 30 09:16:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTROxkaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:38 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb2e77b-b0cc-41f0-849b-3bae2c886692]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:38 user nova-compute[75340]: No targets found.
Nov 30 09:16:38 user nova-compute[75340]: iSNS:
Nov 30 09:16:38 user nova-compute[75340]: No targets found.
Nov 30 09:16:38 user nova-compute[75340]: STATIC:
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:38 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:38 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:38 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:38 user nova-compute[75340]: No targets found.
Nov 30 09:16:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:38 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:38 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ca832-b54f-4157-a447-350452d4a6e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c872a-c092-4340-9a3c-6e43c1acea2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 (non-flash)
Nov 30 09:16:38 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff501251b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f78ec-fd33-4528-9736-47481705cc3c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a788d-6e67-4485-b892-cb538ba2b30a]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b4897-9ca0-4667-ad94-3404bde56161]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebcc6ec-5a37-47c7-99ad-0b19628ac254]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b2dd24-095f-4ccd-a6e3-7182defaa2da]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a29d9e-3997-4f3f-8558-ad60552ecfe4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260]
Nov 30 09:16:39 user nova-compute[75340]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:39 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259fb67-a363-424e-819e-7fcc69937079 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f7a6b-5c4b-49bb-94aa-f7f1198bcb6d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] <== disconnect_volume: return (488ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.utils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ca786-2a05-4392-a452-579849258da8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411230e-b109-4962-92ed-250ff9d89b87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb44ceb5-40ba-4a83-ade3-a0c779b7116d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ace77-96c9-4f50-8991-27148e4fbb02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:39 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5506b55-19bc-445b-b9a2-64455bea5415]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.utils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:39 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 983d3252-e5e7-4cfb-aab1-c717c754a700 is timed out.
Nov 30 09:16:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Successfully detached device sdc from instance 983d3252-e5e7-4cfb-aab1-c717c754a700 from the live domain config.
Nov 30 09:16:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLImAvur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:39 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: INFO nova.compute.manager [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Swapping volume 79ab4fbb-5fb3-49db-9e77-0d29c149dbcc for 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4be13-992b-444a-b9cb-419cd49055ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:39 user nova-compute[75340]: No targets found.
Nov 30 09:16:39 user nova-compute[75340]: iSNS:
Nov 30 09:16:39 user nova-compute[75340]: No targets found.
Nov 30 09:16:39 user nova-compute[75340]: STATIC:
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:39 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:39 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:39 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:39 user nova-compute[75340]: No targets found.
Nov 30 09:16:39 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:39 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:39 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4af9c8f-3e10-4c4a-aa11-db3f47b20c53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a717e73-1929-4246-a5d7-32d630525c2b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:39 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:39 user nova-compute[75340]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a (non-flash)
Nov 30 09:16:39 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff504037f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a'): ({'sdg'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Removing single pathed devices sdg {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[155bc224-38bc-4ebb-a432-4b1b63b7b6e6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[52370ccd-6991-47c1-9676-c4f5a3821e62]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Flushing IO for device /dev/sdg {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d387fe-c4f8-4ff5-a4c8-2a9aba25b09e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4a097-827c-4d22-a010-b18906309cab]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bfafec-26c4-4274-af20-a32b3535edb8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0c696-d03e-48a8-88e6-762c6b887537]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260]
Nov 30 09:16:40 user nova-compute[75340]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d39a3d5-ea22-42f2-9059-a3d3b872167a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[95483e68-19d1-4ada-b5e6-28f5f3002a44]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] <== disconnect_volume: return (455ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'flavor' on Instance uuid b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:16:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:16:40 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=6545MB free_disk=25.453643798828125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9226a77-88f3-4f49-87c3-f16fbb61b83b tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.535s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 30737691-a43b-44ec-93c2-b66868d553ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 983d3252-e5e7-4cfb-aab1-c717c754a700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8737b5bb-6bdb-4293-bae8-3857aded9074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance ef858fe4-a912-4729-9f48-11e473364f13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 42302861-cfa2-4ee8-a769-d8cd942f44e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fc62bd95-5c8b-49e6-b256-d0db7e20f778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9df69524-d3db-4d24-aaa4-f08efdf7c7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:16:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:16:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:16:46 user nova-compute[75340]: INFO nova.compute.claims [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Claim successful on node user
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:16:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:16:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:16:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:16:47 user nova-compute[75340]: DEBUG nova.policy [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14f79ef5cc314a3bb971a811a317a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9daa1b03684fb6b29fa66f0f355e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:16:47 user nova-compute[75340]: INFO nova.virt.block_device [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Booting with blank volume at /dev/vda
Nov 30 09:16:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Successfully created port: 566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:16:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Successfully updated port: 566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-changed-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Refreshing instance network info cache due to event network-changed-566ae665-b699-43cb-8d13-55fd4866990a. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance network_info: |[{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Refreshing network info cache for port 566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:48 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c is timed out.
Nov 30 09:16:48 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Successfully detached device vdb from instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c from the live domain config.
Nov 30 09:16:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUXdSixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:48 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b899852-cfc1-4402-8ad8-fa97e5ca9d10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:49 user nova-compute[75340]: No targets found.
Nov 30 09:16:49 user nova-compute[75340]: iSNS:
Nov 30 09:16:49 user nova-compute[75340]: No targets found.
Nov 30 09:16:49 user nova-compute[75340]: STATIC:
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:49 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:49 user nova-compute[75340]: No targets found.
Nov 30 09:16:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:49 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:49 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a9f7c2-0dbe-45bc-8089-d4dd7ed6dd5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4cffd-f324-40b8-b076-2a9e75c254ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:49 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff511069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290'): ({'sdi'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Removing single pathed devices sdi {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e577de4-2a0a-4601-90a2-14c0465d17ec]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.101s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb7bd2-1e60-48a9-a9c9-762fbd4a92b3]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Flushing IO for device /dev/sdi {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca3eedc-690c-4ef0-ac8a-9a10cd81e2cc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[af089cb2-da10-4029-99f0-8e7d60f656c3]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] SCSI volumes sdi have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe5724-373d-4b41-950b-3e8e522745ce]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updated VIF entry in instance network info cache for port 566ae665-b699-43cb-8d13-55fd4866990a. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3411a17d-2cb9-433c-b022-2574c27060dc req-96f5917b-3f62-4024-86b1-c08e8261b4f6 service nova] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2839e98-0b4a-42a3-a7ed-6af228af2b70]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260]
Nov 30 09:16:49 user nova-compute[75340]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9ba433-2a8c-4fbe-91a2-ff0d8db48290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[81269e3a-57d7-4dac-aed4-b309023c250c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] <== disconnect_volume: return (429ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-changed-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing instance network info cache due to event network-changed-b91bee94-c03b-4c39-942a-c69ba5d153a8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] Acquiring lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] Acquired lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:16:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Refreshing network info cache for port b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.objects.instance [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lazy-loading 'flavor' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updated VIF entry in instance network info cache for port b91bee94-c03b-4c39-942a-c69ba5d153a8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-42b201c5-3e58-4a8d-9758-4cf532c89a59 tempest-VolumesAssistedSnapshotsTest-753471905 tempest-VolumesAssistedSnapshotsTest-753471905-project-admin] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0c685781-57fa-4bfd-83fc-ec9e96d25f53 req-d039a6ae-804a-4575-98ce-6bfb5b080503 service nova] Releasing lock "refresh_cache-42302861-cfa2-4ee8-a769-d8cd942f44e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lazy-loading 'flavor' on Instance uuid 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f59b7957-7c9d-4760-85d9-b3ac114c5f0b tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.294s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'serial': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc'}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'serial'} {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:50 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:50 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:50 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8bb04-bda8-4b62-a265-231b840724c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:16:50 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e1895-ea86-4f31-8bd4-fcba11d0895d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b] added
Nov 30 09:16:50 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961e834-b79e-4173-84a6-c59f6f140819]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc044131-dcf6-4a6d-ad9e-cf6bfb959c48]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmoMVRA {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmoMVRA" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a822c8e3-37c8-442c-9c3d-36dafa112387]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJmoMVRA'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bcdc45-beae-42c2-9e27-b8699a992e3f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c0976-af06-491e-b057-3f85538c4bc7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:50 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:50 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:50 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[54003811-4bc6-4648-ae6e-f2e0e5e29148]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]
Nov 30 09:16:51 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade27231-58d4-4050-9a58-ab2d7ac21a1e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c092e0-8b30-4f70-8a5e-3bbcf180737e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:51 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[412162aa-b14f-49a1-8b93-826e9caa2d11]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:51 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 is timed out.
Nov 30 09:16:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully detached device vdb from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the live domain config.
Nov 30 09:16:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfnPkipZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:51 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:51 user nova-compute[75340]: INFO nova.compute.manager [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Terminating instance
Nov 30 09:16:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23536383139613661', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536383139613661', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.911s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lazy-loading 'flavor' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[002479cf-73df-4e49-814c-bf8780c9e365]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:52 user nova-compute[75340]: No targets found.
Nov 30 09:16:52 user nova-compute[75340]: iSNS:
Nov 30 09:16:52 user nova-compute[75340]: No targets found.
Nov 30 09:16:52 user nova-compute[75340]: STATIC:
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:52 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:52 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:52 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:52 user nova-compute[75340]: No targets found.
Nov 30 09:16:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:52 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:52 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8829b8e-9a1e-459c-852d-79da18a27e3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e9ba5-50d3-4565-bfa1-d83e0a4cab78]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:52 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5035f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa'): ({'sdj'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Removing single pathed devices sdj {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[09edd79e-9aeb-480a-93a6-63a0b3ddb7f4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e4801-63bc-4e15-bfd3-6e1c72abbfbb]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Flushing IO for device /dev/sdj {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c7c317-b078-437b-a892-a16d0ce39283]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.044s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7331777b-2306-44e8-8cf1-8a92840c11e1]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] SCSI volumes sdj have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec98fab-2213-4b30-9852-3a5f1f343187]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02d64c-0415-4fa2-a21e-45e01c1ce8d6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260]
Nov 30 09:16:52 user nova-compute[75340]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d5ac9-91b2-4862-8ff8-2b7933ea12aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1970556-0930-4b75-a2af-d326f98c965a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] <== disconnect_volume: return (1325ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:52 user nova-compute[75340]: INFO nova.compute.manager [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Terminating instance
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-unplugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] No waiting events found dispatching network-vif-unplugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-26024049-1a56-4a6a-98f0-75b2c4f0e66f req-c2761cd3-09eb-4ed2-8ba0-293ea2b849b2 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-unplugged-ffd3921c-2171-4680-aec2-ad94ad431420 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Instance destroyed successfully.
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.objects.instance [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lazy-loading 'resources' on Instance uuid 983d3252-e5e7-4cfb-aab1-c717c754a700 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99391822',display_name='tempest-AttachSCSIVolumeTestJSON-server-99391822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99391822',id=7,image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDXybglUF2cai4BtEsLjVfvDYYXYCSqC2/ZKG2swIxAmAFLJ1Gv5Dm6S4YwxQcas3bMcO3F0wbMwokgXHi3HOb63slLRKQOqZ3G+CBTKVLd/0gdupC4T5p0eUDTIcVRXQ==',key_name='tempest-keypair-116354532',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='832e825eaf1a4caba355a217dbfea563',ramdisk_id='',reservation_id='r-8w65odaw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91f2aaa9-b7a9-4351-be60-6c96f48f658b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-848279881',owner_user_name='tempest-AttachSCSIVolumeTestJSON-848279881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0837b767a8c4b2aa7dbb1b57ad36190',uuid=983d3252-e5e7-4cfb-aab1-c717c754a700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converting VIF {"id": "ffd3921c-2171-4680-aec2-ad94ad431420", "address": "fa:16:3e:83:5c:9c", "network": {"id": "ac6dfdd4-a918-44d0-b834-22af9f9be29c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1851400913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "832e825eaf1a4caba355a217dbfea563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffd3921c-21", "ovs_interfaceid": "ffd3921c-2171-4680-aec2-ad94ad431420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_vif [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffd3921c-21, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b116282-642d-4c0a-aa5e-957e001dacd0 req-a8c31a42-1cb1-4db6-b8d9-1828cefa3864 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-69282295-ea46-4e44-ad8b-baf3afc662ca for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.utils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b56fb4ea-c071-4386-a0eb-5cc458075b71) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c32f30-4b80-4af6-a161-7319db40fe0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[806eb500-361e-41af-b3c1-5c46b4911a65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f58aae-a019-4ca0-ac4c-ce656226d0aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[603959b8-076b-443e-9474-56d98a962357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:53 user nova-compute[75340]: INFO os_vif [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5c:9c,bridge_name='br-int',has_traffic_filtering=True,id=ffd3921c-2171-4680-aec2-ad94ad431420,network=Network(ac6dfdd4-a918-44d0-b834-22af9f9be29c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffd3921c-21')
Nov 30 09:16:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Deleting instance files /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700_del
Nov 30 09:16:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Deletion of /opt/stack/data/nova/instances/983d3252-e5e7-4cfb-aab1-c717c754a700_del complete
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:16:53 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a153a70-cf8d-4704-abe1-63182dce5db8]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG os_brick.utils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating existing volume attachment record: c4ed4685-1371-4a6b-9568-4fb24c23d6ce {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: INFO nova.compute.manager [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e0815a1-405b-4298-860b-541baabc8461 req-3d932d91-0649-426f-b867-8ce41ecd3b9f service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:53 user nova-compute[75340]: DEBUG nova.objects.instance [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'flavor' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-68fbb9f6-f01d-49d5-b352-8d73554f9c71 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.527s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Instance destroyed successfully.
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lazy-loading 'resources' on Instance uuid 42302861-cfa2-4ee8-a769-d8cd942f44e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb91bee94-c0, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 547356672 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d921feb5-3f1e-4345-862a-f5b9aa8beae5) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=b91bee94-c03b-4c39-942a-c69ba5d153a8,network=Network(7c87b10f-5b60-4a50-b029-636a868abc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91bee94-c0')
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69282295-ea, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b03c3398-7ed4-49ed-81fc-9c71461b07aa) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-f71c5627-2342-4438-b804-028e19d9fd25" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-f71c5627-2342-4438-b804-028e19d9fd25" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'flavor' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:16:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:54 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=69282295-ea46-4e44-ad8b-baf3afc662ca,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69282295-ea')
Nov 30 09:16:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf29296f3-ed, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface> {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface> {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Attempting to detach device tapf71c5627-23 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] detach device xml: <interface type="ethernet">
Nov 30 09:16:55 user nova-compute[75340]:   <mac address="fa:16:3e:76:31:09"/>
Nov 30 09:16:55 user nova-compute[75340]:   <model type="virtio"/>
Nov 30 09:16:55 user nova-compute[75340]:   <mtu size="1442"/>
Nov 30 09:16:55 user nova-compute[75340]:   <target dev="tapf71c5627-23"/>
Nov 30 09:16:55 user nova-compute[75340]: </interface>
Nov 30 09:16:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface> {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 09:16:55 user nova-compute[75340]:   <name>instance-00000009</name>
Nov 30 09:16:55 user nova-compute[75340]:   <uuid>8737b5bb-6bdb-4293-bae8-3857aded9074</uuid>
Nov 30 09:16:55 user nova-compute[75340]:   <metadata>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:16:55 user nova-compute[75340]:   <nova:package version="0.0.0"/>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:name>tempest-device-tagging-server-2065242471</nova:name>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:creationTime>2023-11-30 09:16:08</nova:creationTime>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:flavor name="m1.tiny">
Nov 30 09:16:55 user nova-compute[75340]:     <nova:memory>512</nova:memory>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:disk>1</nova:disk>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:swap>0</nova:swap>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:vcpus>1</nova:vcpus>
Nov 30 09:16:55 user nova-compute[75340]:   </nova:flavor>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:owner>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:user uuid="94ee8b1b90db42768cc3ee61d1454f58">tempest-TaggedAttachmentsTest-716106286-project-member</nova:user>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:project uuid="e4ec812897b740438e7f8c6aaf1f245c">tempest-TaggedAttachmentsTest-716106286</nova:project>
Nov 30 09:16:55 user nova-compute[75340]:   </nova:owner>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:16:55 user nova-compute[75340]:   <nova:ports>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:port uuid="9ec18e6c-a83d-430b-bf00-0719c095b253">
Nov 30 09:16:55 user nova-compute[75340]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:16:55 user nova-compute[75340]:     </nova:port>
Nov 30 09:16:55 user nova-compute[75340]:     <nova:port uuid="f71c5627-2342-4438-b804-028e19d9fd25">
Nov 30 09:16:55 user nova-compute[75340]:       <nova:ip type="fixed" address="10.10.10.59" ipVersion="4"/>
Nov 30 09:16:55 user nova-compute[75340]:     </nova:port>
Nov 30 09:16:55 user nova-compute[75340]:   </nova:ports>
Nov 30 09:16:55 user nova-compute[75340]: </nova:instance>
Nov 30 09:16:55 user nova-compute[75340]:   </metadata>
Nov 30 09:16:55 user nova-compute[75340]:   <memory unit='KiB'>524288</memory>
Nov 30 09:16:55 user nova-compute[75340]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 09:16:55 user nova-compute[75340]:   <vcpu placement='static'>1</vcpu>
Nov 30 09:16:55 user nova-compute[75340]:   <resource>
Nov 30 09:16:55 user nova-compute[75340]:     <partition>/machine</partition>
Nov 30 09:16:55 user nova-compute[75340]:   </resource>
Nov 30 09:16:55 user nova-compute[75340]:   <sysinfo type='smbios'>
Nov 30 09:16:55 user nova-compute[75340]:     <system>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='version'>0.0.0</entry>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='serial'>8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='uuid'>8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:16:55 user nova-compute[75340]:       <entry name='family'>Virtual Machine</entry>
Nov 30 09:16:55 user nova-compute[75340]:     </system>
Nov 30 09:16:55 user nova-compute[75340]:   </sysinfo>
Nov 30 09:16:55 user nova-compute[75340]:   <os>
Nov 30 09:16:55 user nova-compute[75340]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 09:16:55 user nova-compute[75340]:     <boot dev='hd'/>
Nov 30 09:16:55 user nova-compute[75340]:     <smbios mode='sysinfo'/>
Nov 30 09:16:55 user nova-compute[75340]:   </os>
Nov 30 09:16:55 user nova-compute[75340]:   <features>
Nov 30 09:16:55 user nova-compute[75340]:     <acpi/>
Nov 30 09:16:55 user nova-compute[75340]:     <apic/>
Nov 30 09:16:55 user nova-compute[75340]:     <vmcoreinfo state='on'/>
Nov 30 09:16:55 user nova-compute[75340]:   </features>
Nov 30 09:16:55 user nova-compute[75340]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 09:16:55 user nova-compute[75340]:     <model fallback='forbid'>Nehalem</model>
Nov 30 09:16:55 user nova-compute[75340]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 09:16:55 user nova-compute[75340]:     <feature policy='require' name='vme'/>
Nov 30 09:16:55 user nova-compute[75340]:     <feature policy='require' name='x2apic'/>
Nov 30 09:16:55 user nova-compute[75340]:     <feature policy='require' name='hypervisor'/>
Nov 30 09:16:55 user nova-compute[75340]:   </cpu>
Nov 30 09:16:55 user nova-compute[75340]:   <clock offset='utc'>
Nov 30 09:16:55 user nova-compute[75340]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 09:16:55 user nova-compute[75340]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 09:16:55 user nova-compute[75340]:     <timer name='hpet' present='no'/>
Nov 30 09:16:55 user nova-compute[75340]:   </clock>
Nov 30 09:16:55 user nova-compute[75340]:   <on_poweroff>destroy</on_poweroff>
Nov 30 09:16:55 user nova-compute[75340]:   <on_reboot>restart</on_reboot>
Nov 30 09:16:55 user nova-compute[75340]:   <on_crash>destroy</on_crash>
Nov 30 09:16:55 user nova-compute[75340]:   <devices>
Nov 30 09:16:55 user nova-compute[75340]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 09:16:55 user nova-compute[75340]:     <disk type='file' device='disk'>
Nov 30 09:16:55 user nova-compute[75340]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 09:16:55 user nova-compute[75340]:       <source file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk' index='2'/>
Nov 30 09:16:55 user nova-compute[75340]:       <backingStore type='file' index='3'>
Nov 30 09:16:55 user nova-compute[75340]:         <format type='raw'/>
Nov 30 09:16:55 user nova-compute[75340]:         <source file='/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb'/>
Nov 30 09:16:55 user nova-compute[75340]:         <backingStore/>
Nov 30 09:16:55 user nova-compute[75340]:       </backingStore>
Nov 30 09:16:55 user nova-compute[75340]:       <target dev='vda' bus='virtio'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='virtio-disk0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </disk>
Nov 30 09:16:55 user nova-compute[75340]:     <disk type='file' device='cdrom'>
Nov 30 09:16:55 user nova-compute[75340]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 09:16:55 user nova-compute[75340]:       <source file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config' index='1'/>
Nov 30 09:16:55 user nova-compute[75340]:       <backingStore/>
Nov 30 09:16:55 user nova-compute[75340]:       <target dev='hda' bus='ide'/>
Nov 30 09:16:55 user nova-compute[75340]:       <readonly/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='ide0-0-0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </disk>
Nov 30 09:16:55 user nova-compute[75340]:     <controller type='usb' index='0' model='none'>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='usb'/>
Nov 30 09:16:55 user nova-compute[75340]:     </controller>
Nov 30 09:16:55 user nova-compute[75340]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='pci.0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </controller>
Nov 30 09:16:55 user nova-compute[75340]:     <controller type='ide' index='0'>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='ide'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 09:16:55 user nova-compute[75340]:     </controller>
Nov 30 09:16:55 user nova-compute[75340]:     <interface type='ethernet'>
Nov 30 09:16:55 user nova-compute[75340]:       <mac address='fa:16:3e:b5:e3:d1'/>
Nov 30 09:16:55 user nova-compute[75340]:       <target dev='tap9ec18e6c-a8'/>
Nov 30 09:16:55 user nova-compute[75340]:       <model type='virtio'/>
Nov 30 09:16:55 user nova-compute[75340]:       <mtu size='1442'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='net0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </interface>
Nov 30 09:16:55 user nova-compute[75340]:     <interface type='ethernet'>
Nov 30 09:16:55 user nova-compute[75340]:       <mac address='fa:16:3e:76:31:09'/>
Nov 30 09:16:55 user nova-compute[75340]:       <target dev='tapf71c5627-23'/>
Nov 30 09:16:55 user nova-compute[75340]:       <model type='virtio'/>
Nov 30 09:16:55 user nova-compute[75340]:       <mtu size='1442'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='net1'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </interface>
Nov 30 09:16:55 user nova-compute[75340]:     <serial type='pty'>
Nov 30 09:16:55 user nova-compute[75340]:       <source path='/dev/pts/9'/>
Nov 30 09:16:55 user nova-compute[75340]:       <log file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log' append='off'/>
Nov 30 09:16:55 user nova-compute[75340]:       <target type='isa-serial' port='0'>
Nov 30 09:16:55 user nova-compute[75340]:         <model name='isa-serial'/>
Nov 30 09:16:55 user nova-compute[75340]:       </target>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='serial0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </serial>
Nov 30 09:16:55 user nova-compute[75340]:     <console type='pty' tty='/dev/pts/9'>
Nov 30 09:16:55 user nova-compute[75340]:       <source path='/dev/pts/9'/>
Nov 30 09:16:55 user nova-compute[75340]:       <log file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log' append='off'/>
Nov 30 09:16:55 user nova-compute[75340]:       <target type='serial' port='0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='serial0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </console>
Nov 30 09:16:55 user nova-compute[75340]:     <input type='mouse' bus='ps2'>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='input0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </input>
Nov 30 09:16:55 user nova-compute[75340]:     <input type='keyboard' bus='ps2'>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='input1'/>
Nov 30 09:16:55 user nova-compute[75340]:     </input>
Nov 30 09:16:55 user nova-compute[75340]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 09:16:55 user nova-compute[75340]:       <listen type='address' address='0.0.0.0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </graphics>
Nov 30 09:16:55 user nova-compute[75340]:     <audio id='1' type='none'/>
Nov 30 09:16:55 user nova-compute[75340]:     <video>
Nov 30 09:16:55 user nova-compute[75340]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='video0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </video>
Nov 30 09:16:55 user nova-compute[75340]:     <memballoon model='virtio'>
Nov 30 09:16:55 user nova-compute[75340]:       <stats period='10'/>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='balloon0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </memballoon>
Nov 30 09:16:55 user nova-compute[75340]:     <rng model='virtio'>
Nov 30 09:16:55 user nova-compute[75340]:       <backend model='random'>/dev/urandom</backend>
Nov 30 09:16:55 user nova-compute[75340]:       <alias name='rng0'/>
Nov 30 09:16:55 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 09:16:55 user nova-compute[75340]:     </rng>
Nov 30 09:16:55 user nova-compute[75340]:   </devices>
Nov 30 09:16:55 user nova-compute[75340]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 09:16:55 user nova-compute[75340]:     <label>libvirt-8737b5bb-6bdb-4293-bae8-3857aded9074</label>
Nov 30 09:16:55 user nova-compute[75340]:     <imagelabel>libvirt-8737b5bb-6bdb-4293-bae8-3857aded9074</imagelabel>
Nov 30 09:16:55 user nova-compute[75340]:   </seclabel>
Nov 30 09:16:55 user nova-compute[75340]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 09:16:55 user nova-compute[75340]:     <label>+64055:+108</label>
Nov 30 09:16:55 user nova-compute[75340]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 09:16:55 user nova-compute[75340]:   </seclabel>
Nov 30 09:16:55 user nova-compute[75340]: </domain>
Nov 30 09:16:55 user nova-compute[75340]:  {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 09:16:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully detached device tapf71c5627-23 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the persistent domain config.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] (1/8): Attempting to detach device tapf71c5627-23 with device alias net1 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] detach device xml: <interface type="ethernet">
Nov 30 09:16:55 user nova-compute[75340]:   <mac address="fa:16:3e:76:31:09"/>
Nov 30 09:16:55 user nova-compute[75340]:   <model type="virtio"/>
Nov 30 09:16:55 user nova-compute[75340]:   <mtu size="1442"/>
Nov 30 09:16:55 user nova-compute[75340]:   <target dev="tapf71c5627-23"/>
Nov 30 09:16:55 user nova-compute[75340]: </interface>
Nov 30 09:16:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39eadd66-6372-45d3-8762-11b14d5201d0) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e6:8b,bridge_name='br-int',has_traffic_filtering=True,id=f29296f3-eda1-4039-9561-f5588f663248,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf29296f3-ed')
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap324667bd-a1, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43f0b45b-858f-41c0-832c-551c6f9c4356) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 688914432 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Acquiring lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] No waiting events found dispatching network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received unexpected event network-vif-plugged-ffd3921c-2171-4680-aec2-ad94ad431420 for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-b91bee94-c03b-4c39-942a-c69ba5d153a8 for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-513af6f9-dbc1-4679-9af8-1f26155ff832 req-2adfa3e0-fbd4-4aa3-b4b8-0f62bf76adfd service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-f29296f3-eda1-4039-9561-f5588f663248 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:5c,bridge_name='br-int',has_traffic_filtering=True,id=324667bd-a18f-47f9-b0ec-9a3097b915a2,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324667bd-a1')
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-69282295-ea46-4e44-ad8b-baf3afc662ca for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-0bf91c86-eb24-45a5-82e3-003d73f2ac4e req-5d26fce1-4e28-4dc6-939d-ca3ebe867225 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12a0ff8d-85, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Start waiting for the detach event from libvirt for device tapf71c5627-23 with device alias net1 for instance 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=669e1dac-ba58-4c47-95f5-e0415e93b42c) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-324667bd-a18f-47f9-b0ec-9a3097b915a2 for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-unplugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-unplugged-12a0ff8d-859c-456c-a0de-b437089898d0 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING nova.compute.manager [req-15bc076b-2ad2-491b-b565-8e87f7cfc56b req-2f36113b-92ab-42d6-a65f-2b80aa4c5463 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-12a0ff8d-859c-456c-a0de-b437089898d0 for instance with vm_state active and task_state deleting.
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:4c:38,bridge_name='br-int',has_traffic_filtering=True,id=12a0ff8d-859c-456c-a0de-b437089898d0,network=Network(ab49ce4f-a0d2-471b-b4a6-7a213a2ed846),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a0ff8d-85')
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6d71e38-85, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e9c4077-a4d6-4778-bbd2-8a79d9e96dfe) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=e6d71e38-852a-4c2c-8fb9-5403b0fa30ce,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d71e38-85')
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843631414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843631414',id=12,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGn1L36kRL7FsHBqBdMOM4zDPyp6e0SUZcmXnJyU8xpDpjTYvwtcEhTxsyNnawd+fLAAwbqxV2mJFO82ZBdyUtGXrRik+Vh1l4vNyck93G15aKMJO+k+zWnu30ZlIhmfg==',key_name='tempest-keypair-1987996609',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242d410e64b146608432809b9de3ddaf',ramdisk_id='',reservation_id='r-9jh7a0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-46414645',owner_user_name='tempest-TaggedBootDevicesTest-46414645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb8b26c84cc4e869edeec4cbd17ad05',uuid=42302861-cfa2-4ee8-a769-d8cd942f44e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converting VIF {"id": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "address": "fa:16:3e:97:80:e5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d98b117-d9", "ovs_interfaceid": "8d98b117-d9a7-441c-a3b3-7d928bd80eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d98b117-d9, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6cfd34c-3fbf-45a5-9a91-2b7b048711fd) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 845152256 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:55 user nova-compute[75340]: INFO os_vif [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8,network=Network(0a7ea673-8129-480b-976e-c35d5d61309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d98b117-d9')
Nov 30 09:16:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdpwHEhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:55 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7314288-7429-4325-9663-abd14d4942fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:55 user nova-compute[75340]: No targets found.
Nov 30 09:16:55 user nova-compute[75340]: iSNS:
Nov 30 09:16:55 user nova-compute[75340]: No targets found.
Nov 30 09:16:55 user nova-compute[75340]: STATIC:
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:55 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:55 user nova-compute[75340]: No targets found.
Nov 30 09:16:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:55 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:55 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4f3f8-b20d-4bb2-94db-79999c97836e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a278ba-7966-4d78-8194-4622f2b77206]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:55 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5063f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff6708-c26d-4df6-b618-714a09fbbcbf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0b8469-e4fa-4d84-98e2-9c070df14c9b]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b93fe3-0df5-448d-9664-5063446a6ad1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dbf6cf-e987-4783-83ee-ace824588efb]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6781aa-4e5f-4cf1-8975-cfdea66cd1d7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be050c48-b305-4d20-96bd-40ca8ef9472e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260]
Nov 30 09:16:56 user nova-compute[75340]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c04531-0c0e-42c7-93e5-ec37f2bae95f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253e253-8691-434a-b9d7-4663d62c7121]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== disconnect_volume: return (469ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMWAIRoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:56 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Took 2.77 seconds to deallocate network for instance.
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 994050048 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[63254ef1-ac9a-4dc4-beda-cc5cf97bc1c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]: iSNS:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]: STATIC:
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:56 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:56 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce5ab3-8f8e-4c6c-9503-159b68770ce2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b3351f-55e8-4ea9-8612-f4146a188503]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaca52c-9bd4-4bde-ba2a-c4a053fdd50f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff9e0e-0e50-445f-9291-ec29f2945ad8]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a05d5d6-8f5b-42f7-8519-d282816bfe6d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[333050d8-62e0-4c1a-a41b-37cbe7c9643a]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae204bb9-66c4-4762-803d-e104a65b174f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[561f74d4-43f5-4738-8540-b211b06a13ea]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260]
Nov 30 09:16:56 user nova-compute[75340]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61551bff-e2cc-4969-a73a-e0cd52dd7323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd827ea-58b8-43a1-9a05-fcce50fb724e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== disconnect_volume: return (384ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFygNnuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[54890f17-4d62-42cc-9f8b-39a30bc474b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]: iSNS:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]: STATIC:
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a
Nov 30 09:16:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:56 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:56 user nova-compute[75340]: No targets found.
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:56 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:56 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc5b8c-7d1b-485b-8994-76f584257150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1598ce-2d55-48da-866c-50f4718be9f8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a (non-flash)
Nov 30 09:16:56 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19b36d-cfde-4231-be49-07eab55c929a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a0f779-d217-406c-8545-65f90065b77f]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81f439-94bd-43dd-bc55-85781f121753]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b9e28-6b53-4a64-a120-71ab3bb24eae]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[18337566-c48f-448d-86e9-7231794afc95]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEMmZSAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '79ab4fbb-5fb3-49db-9e77-0d29c149dbcc'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:16:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:16:56 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Deleted allocations for instance 983d3252-e5e7-4cfb-aab1-c717c754a700
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96f8cb-a60e-4726-8732-395f4ac73217]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260]
Nov 30 09:16:56 user nova-compute[75340]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4ad071d-4010-40c7-8cdd-70860a5c4b7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10413b6-35a7-4588-8871-63424c096211]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] <== disconnect_volume: return (338ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Deleting instance files /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7_del
Nov 30 09:16:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Deletion of /opt/stack/data/nova/instances/42302861-cfa2-4ee8-a769-d8cd942f44e7_del complete
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.095s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cff8c4-2d9f-4df9-a5bd-f936d22d2998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:16:57 user nova-compute[75340]: No targets found.
Nov 30 09:16:57 user nova-compute[75340]: iSNS:
Nov 30 09:16:57 user nova-compute[75340]: No targets found.
Nov 30 09:16:57 user nova-compute[75340]: STATIC:
Nov 30 09:16:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc
Nov 30 09:16:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:16:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:16:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:16:57 user nova-compute[75340]: FIRMWARE:
Nov 30 09:16:57 user nova-compute[75340]: No targets found.
Nov 30 09:16:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:16:57 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:16:57 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d0f8d-bdef-4e0b-9c6c-a985d6dcfa0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0dca2a21-fa4b-4e30-a258-a123fae412d9 tempest-AttachSCSIVolumeTestJSON-848279881 tempest-AttachSCSIVolumeTestJSON-848279881-project-member] Lock "983d3252-e5e7-4cfb-aab1-c717c754a700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.218s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: INFO nova.compute.manager [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Took 4.49 seconds to destroy the instance on the hypervisor.
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b316f32-5375-4396-ad3b-d4aa6080370b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:57 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:57 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc (non-flash)
Nov 30 09:16:57 user nova-compute[75340]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:16:57 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:16:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5035dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc'): ({'sdk'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Removing single pathed devices sdk {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7521e0-db00-4e0b-b0e7-033bafd63cc7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab8bcb-58cc-4264-bfb4-52bc8eb4180e]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Flushing IO for device /dev/sdk {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11baf902-b224-4f52-b9e8-7d32c0133ad2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6b9a6-6c05-49cc-a695-7890bf02abe7]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] SCSI volumes sdk have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc65786-b45a-411d-b7bd-fd7002ebda51]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.125s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[08307b45-a915-4d25-82f0-4e4eb6657893]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260]
Nov 30 09:16:57 user nova-compute[75340]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc, portal: 172.16.0.220,3260] successful.
Nov 30 09:16:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-unplugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-unplugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:57 user nova-compute[75340]: WARNING nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-unplugged-f71c5627-2342-4438-b804-028e19d9fd25 for instance with vm_state active and task_state None.
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:57 user nova-compute[75340]: WARNING nova.compute.manager [req-917570f8-0a1d-46ad-8440-6d90acd224be req-424abc8b-591c-4bd4-ac26-62a52f9d178e service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-f71c5627-2342-4438-b804-028e19d9fd25 for instance with vm_state active and task_state None.
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] Acquiring lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] No waiting events found dispatching network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:16:57 user nova-compute[75340]: WARNING nova.compute.manager [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received unexpected event network-vif-plugged-f29296f3-eda1-4039-9561-f5588f663248 for instance with vm_state active and task_state deleting.
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-a079a2c0-4c0a-4572-821b-242d1f78c146 req-d9ace398-004c-4a7d-b303-8deb3d15bbf9 service nova] [instance: 983d3252-e5e7-4cfb-aab1-c717c754a700] Received event network-vif-deleted-ffd3921c-2171-4680-aec2-ad94ad431420 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ab4fbb-5fb3-49db-9e77-0d29c149dbcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[047d58a2-287b-4f99-b295-1e7005e75482]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] <== disconnect_volume: return (507ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ef858fe4-a912-4729-9f48-11e473364f13', 'attached_at': '', 'detached_at': '', 'volume_id': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'serial'} {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 09:16:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: removing Cinder connection for volume 79ab4fbb-5fb3-49db-9e77-0d29c149dbcc {{(pid=75340) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 09:16:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:16:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] [instance: ef858fe4-a912-4729-9f48-11e473364f13] swap_volume: Updating volume 79ab4fbb-5fb3-49db-9e77-0d29c149dbcc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "gJmoMVRA", "auth_password": "no48mYbaWeU6Bk", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b"}, "status": "reserved", "instance": "ef858fe4-a912-4729-9f48-11e473364f13", "attached_at": "", "detached_at": "", "volume_id": "49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b", "serial": "49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'no_device': None, 'attachment_id': '4d1e9de2-b93c-4234-9122-febca73b669c'} {{(pid=75340) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 09:16:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f8522bb6-b76b-4ccd-9097-4bb819c0800c tempest-TestVolumeSwap-533709238 tempest-TestVolumeSwap-533709238-project-admin] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.205s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-deleted-8d98b117-d9a7-441c-a3b3-7d928bd80eb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:59 user nova-compute[75340]: INFO nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Neutron deleted interface 8d98b117-d9a7-441c-a3b3-7d928bd80eb8; detaching it from the instance and deleting it from the info cache
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "address": "fa:16:3e:b8:44:5c", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324667bd-a1", "ovs_interfaceid": "324667bd-a18f-47f9-b0ec-9a3097b915a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Detach interface failed, port_id=8d98b117-d9a7-441c-a3b3-7d928bd80eb8, reason: Instance 42302861-cfa2-4ee8-a769-d8cd942f44e7 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-deleted-324667bd-a18f-47f9-b0ec-9a3097b915a2 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:16:59 user nova-compute[75340]: INFO nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Neutron deleted interface 324667bd-a18f-47f9-b0ec-9a3097b915a2; detaching it from the instance and deleting it from the info cache
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [{"id": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "address": "fa:16:3e:e5:79:c5", "network": {"id": "7c87b10f-5b60-4a50-b029-636a868abc8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1315974874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91bee94-c0", "ovs_interfaceid": "b91bee94-c03b-4c39-942a-c69ba5d153a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69282295-ea46-4e44-ad8b-baf3afc662ca", "address": "fa:16:3e:81:e5:e8", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69282295-ea", "ovs_interfaceid": "69282295-ea46-4e44-ad8b-baf3afc662ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f29296f3-eda1-4039-9561-f5588f663248", "address": "fa:16:3e:2a:e6:8b", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29296f3-ed", "ovs_interfaceid": "f29296f3-eda1-4039-9561-f5588f663248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12a0ff8d-859c-456c-a0de-b437089898d0", "address": "fa:16:3e:52:4c:38", "network": {"id": "ab49ce4f-a0d2-471b-b4a6-7a213a2ed846", "bridge": "br-int", "label": "tempest-device-tagging-net1-1607268097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a0ff8d-85", "ovs_interfaceid": "12a0ff8d-859c-456c-a0de-b437089898d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "address": "fa:16:3e:3b:74:a5", "network": {"id": "0a7ea673-8129-480b-976e-c35d5d61309a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1817984272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "242d410e64b146608432809b9de3ddaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d71e38-85", "ovs_interfaceid": "e6d71e38-852a-4c2c-8fb9-5403b0fa30ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7690e1a-1d89-49b4-9a33-482f2db0a4ff req-c3f11d8a-ecb0-41d0-bbc6-1500aadc5809 service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Detach interface failed, port_id=324667bd-a18f-47f9-b0ec-9a3097b915a2, reason: Instance 42302861-cfa2-4ee8-a769-d8cd942f44e7 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:16:59 user nova-compute[75340]: INFO nova.compute.manager [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Detaching volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:16:59 user nova-compute[75340]: INFO nova.virt.block_device [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Attempting to driver detach volume 49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b from mountpoint /dev/vdb
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Attempting to detach device vdb from instance ef858fe4-a912-4729-9f48-11e473364f13 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:59 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:59 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:16:59 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:59 user nova-compute[75340]:   <serial>49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b</serial>
Nov 30 09:16:59 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:59 user nova-compute[75340]: </disk>
Nov 30 09:16:59 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:16:59 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Successfully detached device vdb from instance ef858fe4-a912-4729-9f48-11e473364f13 from the persistent domain config.
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef858fe4-a912-4729-9f48-11e473364f13 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:16:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:16:59 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:16:59 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:16:59 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:16:59 user nova-compute[75340]:   <serial>49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b</serial>
Nov 30 09:16:59 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:16:59 user nova-compute[75340]: </disk>
Nov 30 09:16:59 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:17:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:17:00 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:00 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Took 3.48 seconds to deallocate network for instance.
Nov 30 09:17:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-a24d3714-5100-42c0-9f58-f7cc1c942429 req-b0cbbcf6-3177-461f-9554-52b1e817c4bc service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-deleted-e6d71e38-852a-4c2c-8fb9-5403b0fa30ce {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-a24d3714-5100-42c0-9f58-f7cc1c942429 req-b0cbbcf6-3177-461f-9554-52b1e817c4bc service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-deleted-12a0ff8d-859c-456c-a0de-b437089898d0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-a24d3714-5100-42c0-9f58-f7cc1c942429 req-b0cbbcf6-3177-461f-9554-52b1e817c4bc service nova] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Received event network-vif-deleted-b91bee94-c03b-4c39-942a-c69ba5d153a8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:02 user nova-compute[75340]: INFO nova.compute.manager [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] [instance: 42302861-cfa2-4ee8-a769-d8cd942f44e7] Took 2.39 seconds to detach 3 volumes for instance.
Nov 30 09:17:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:03 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:03 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Deleted allocations for instance 42302861-cfa2-4ee8-a769-d8cd942f44e7
Nov 30 09:17:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fbe7f501-606e-40c3-8930-7b6e1c71e7ea tempest-TaggedBootDevicesTest-46414645 tempest-TaggedBootDevicesTest-46414645-project-member] Lock "42302861-cfa2-4ee8-a769-d8cd942f44e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:17:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Creating image(s)
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Ensure instance console log exists: /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start _get_guest_xml network_info=[{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c4ed4685-1371-4a6b-9568-4fb24c23d6ce', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f707e1f-21fa-4122-94ee-7eb3f28df193', 'attached_at': '', 'detached_at': '', 'volume_id': 'a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'serial': 'a40d2f72-8aa2-47d8-b17f-0a570cca371f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:17:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:04 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fff263-e8f4-404c-8e1e-a01bc78127ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:17:04 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e903dad-948a-43e0-b516-c9e4eefb921f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f] added
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5213b-32e3-4002-bc3e-177958517620]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b6b5c-cf19-46cd-9e43-3105d9b20814]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShcrkPlH {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShcrkPlH" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[463cc339-c600-4c13-a308-1520becbb9fb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShcrkPlH'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee9d1e-559d-4c52-9e25-918ef82eb181]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[17692b8d-2e2b-4328-8a63-058ef485be12]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9017abae-797e-43b7-8c0c-cc51b24579d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260]
Nov 30 09:17:04 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260] successful.
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[00158f59-4e80-4512-ad4e-fd027572fe5f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd5f30-c4e1-472d-a1e1-0fae6e68922e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:04 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fb99e-04ab-4b29-b94c-72c1a4366329]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:17:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26665343465363539', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665343465363539', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1987351367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1987351367',id=15,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-k2ynkn0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:16:47Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=3f707e1f-21fa-4122-94ee-7eb3f28df193,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:17:05 user nova-compute[75340]:   <uuid>3f707e1f-21fa-4122-94ee-7eb3f28df193</uuid>
Nov 30 09:17:05 user nova-compute[75340]:   <name>instance-0000000f</name>
Nov 30 09:17:05 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:17:05 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:17:05 user nova-compute[75340]:   <metadata>
Nov 30 09:17:05 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:05 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1987351367</nova:name>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:17:04</nova:creationTime>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:17:05 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:05 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:owner>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:17:05 user nova-compute[75340]:       </nova:owner>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:05 user nova-compute[75340]:       <nova:ports>
Nov 30 09:17:05 user nova-compute[75340]:         <nova:port uuid="566ae665-b699-43cb-8d13-55fd4866990a">
Nov 30 09:17:05 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:17:05 user nova-compute[75340]:         </nova:port>
Nov 30 09:17:05 user nova-compute[75340]:       </nova:ports>
Nov 30 09:17:05 user nova-compute[75340]:     </nova:instance>
Nov 30 09:17:05 user nova-compute[75340]:   </metadata>
Nov 30 09:17:05 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:17:05 user nova-compute[75340]:     <system>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="serial">3f707e1f-21fa-4122-94ee-7eb3f28df193</entry>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="uuid">3f707e1f-21fa-4122-94ee-7eb3f28df193</entry>
Nov 30 09:17:05 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:17:05 user nova-compute[75340]:     </system>
Nov 30 09:17:05 user nova-compute[75340]:   </sysinfo>
Nov 30 09:17:05 user nova-compute[75340]:   <os>
Nov 30 09:17:05 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:17:05 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:17:05 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:17:05 user nova-compute[75340]:   </os>
Nov 30 09:17:05 user nova-compute[75340]:   <features>
Nov 30 09:17:05 user nova-compute[75340]:     <acpi/>
Nov 30 09:17:05 user nova-compute[75340]:     <apic/>
Nov 30 09:17:05 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:17:05 user nova-compute[75340]:   </features>
Nov 30 09:17:05 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:17:05 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:17:05 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:17:05 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:17:05 user nova-compute[75340]:   </clock>
Nov 30 09:17:05 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:17:05 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:17:05 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:17:05 user nova-compute[75340]:   </cpu>
Nov 30 09:17:05 user nova-compute[75340]:   <devices>
Nov 30 09:17:05 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:17:05 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:17:05 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:17:05 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:17:05 user nova-compute[75340]:       <serial>a40d2f72-8aa2-47d8-b17f-0a570cca371f</serial>
Nov 30 09:17:05 user nova-compute[75340]:     </disk>
Nov 30 09:17:05 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:17:05 user nova-compute[75340]:       <mac address="fa:16:3e:ae:90:b9"/>
Nov 30 09:17:05 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:05 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:17:05 user nova-compute[75340]:       <target dev="tap566ae665-b6"/>
Nov 30 09:17:05 user nova-compute[75340]:     </interface>
Nov 30 09:17:05 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:17:05 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/console.log" append="off"/>
Nov 30 09:17:05 user nova-compute[75340]:     </serial>
Nov 30 09:17:05 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:17:05 user nova-compute[75340]:     <video>
Nov 30 09:17:05 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:05 user nova-compute[75340]:     </video>
Nov 30 09:17:05 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:17:05 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:17:05 user nova-compute[75340]:     </rng>
Nov 30 09:17:05 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:17:05 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:17:05 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:17:05 user nova-compute[75340]:     </memballoon>
Nov 30 09:17:05 user nova-compute[75340]:   </devices>
Nov 30 09:17:05 user nova-compute[75340]: </domain>
Nov 30 09:17:05 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1987351367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1987351367',id=15,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-k2ynkn0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:16:47Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=3f707e1f-21fa-4122-94ee-7eb3f28df193,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG os_vif [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0523ba54-ac43-5dfd-96cc-3a717fcbf01a', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap566ae665-b6, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap566ae665-b6, col_values=(('qos', UUID('97515ea3-7a28-41e2-8563-9ff2fcd95250')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap566ae665-b6, col_values=(('external_ids', {'iface-id': '566ae665-b699-43cb-8d13-55fd4866990a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:90:b9', 'vm-uuid': '3f707e1f-21fa-4122-94ee-7eb3f28df193'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:05 user nova-compute[75340]: INFO os_vif [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6')
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:ae:90:b9, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:07 user nova-compute[75340]: WARNING nova.compute.manager [req-d7125f70-0923-4aa6-a620-c595aff36cd9 req-bdd9d124-dedc-45ee-8280-63c517f35f32 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state building and task_state spawning.
Nov 30 09:17:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:17:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance spawned successfully.
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:09 user nova-compute[75340]: INFO nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:09 user nova-compute[75340]: WARNING nova.compute.manager [req-0f253745-aec4-4843-8691-0ea71664a1f0 req-eaa53112-d04f-46db-bbfe-c482c1637924 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state building and task_state spawning.
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:17:09 user nova-compute[75340]: INFO nova.compute.manager [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Took 23.24 seconds to build instance.
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-61971ca8-080f-4b2d-a9e6-caa1ec816ed6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.348s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:17:09 user nova-compute[75340]: INFO nova.compute.claims [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Claim successful on node user
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:17:10 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.policy [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5b50ed776a541748fbfc920306c4f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6721267c2994f9b9af9947a9e228d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:17:10 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Creating image(s)
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "/opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "/opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "/opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk 1073741824" returned: 0 in 0.051s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Successfully created port: 316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:10 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Cannot resize image /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Ensure instance console log exists: /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Successfully updated port: 316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquired lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-changed-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Refreshing instance network info cache due to event network-changed-316c6d06-b71e-4282-afa1-6476ae783519. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:17:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] Acquiring lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Updating instance_info_cache with network_info: [{"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Releasing lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Instance network_info: |[{"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] Acquired lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Refreshing network info cache for port 316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Start _get_guest_xml network_info=[{"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:17:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-311998467',display_name='tempest-VolumesAdminNegativeTest-server-311998467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-311998467',id=16,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-9z0i7p45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:10Z,user_data=None,user_id='a5b50ed776a541748fbfc920306c4f43',uuid=775afdeb-983c-44cf-be40-ad56aa1ab226,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'pci_devices' on Instance uuid 775afdeb-983c-44cf-be40-ad56aa1ab226 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:17:12 user nova-compute[75340]:   <uuid>775afdeb-983c-44cf-be40-ad56aa1ab226</uuid>
Nov 30 09:17:12 user nova-compute[75340]:   <name>instance-00000010</name>
Nov 30 09:17:12 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:17:12 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:17:12 user nova-compute[75340]:   <metadata>
Nov 30 09:17:12 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:12 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:name>tempest-VolumesAdminNegativeTest-server-311998467</nova:name>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:17:12</nova:creationTime>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:17:12 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:12 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:owner>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:user uuid="a5b50ed776a541748fbfc920306c4f43">tempest-VolumesAdminNegativeTest-1287326145-project-member</nova:user>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:project uuid="c6721267c2994f9b9af9947a9e228d72">tempest-VolumesAdminNegativeTest-1287326145</nova:project>
Nov 30 09:17:12 user nova-compute[75340]:       </nova:owner>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:12 user nova-compute[75340]:       <nova:ports>
Nov 30 09:17:12 user nova-compute[75340]:         <nova:port uuid="316c6d06-b71e-4282-afa1-6476ae783519">
Nov 30 09:17:12 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 09:17:12 user nova-compute[75340]:         </nova:port>
Nov 30 09:17:12 user nova-compute[75340]:       </nova:ports>
Nov 30 09:17:12 user nova-compute[75340]:     </nova:instance>
Nov 30 09:17:12 user nova-compute[75340]:   </metadata>
Nov 30 09:17:12 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:17:12 user nova-compute[75340]:     <system>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="serial">775afdeb-983c-44cf-be40-ad56aa1ab226</entry>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="uuid">775afdeb-983c-44cf-be40-ad56aa1ab226</entry>
Nov 30 09:17:12 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:17:12 user nova-compute[75340]:     </system>
Nov 30 09:17:12 user nova-compute[75340]:   </sysinfo>
Nov 30 09:17:12 user nova-compute[75340]:   <os>
Nov 30 09:17:12 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:17:12 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:17:12 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:17:12 user nova-compute[75340]:   </os>
Nov 30 09:17:12 user nova-compute[75340]:   <features>
Nov 30 09:17:12 user nova-compute[75340]:     <acpi/>
Nov 30 09:17:12 user nova-compute[75340]:     <apic/>
Nov 30 09:17:12 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:17:12 user nova-compute[75340]:   </features>
Nov 30 09:17:12 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:17:12 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:17:12 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:17:12 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:17:12 user nova-compute[75340]:   </clock>
Nov 30 09:17:12 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:17:12 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:17:12 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:17:12 user nova-compute[75340]:   </cpu>
Nov 30 09:17:12 user nova-compute[75340]:   <devices>
Nov 30 09:17:12 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:17:12 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:17:12 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk"/>
Nov 30 09:17:12 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:17:12 user nova-compute[75340]:     </disk>
Nov 30 09:17:12 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:17:12 user nova-compute[75340]:       <mac address="fa:16:3e:9c:b7:66"/>
Nov 30 09:17:12 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:12 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:17:12 user nova-compute[75340]:       <target dev="tap316c6d06-b7"/>
Nov 30 09:17:12 user nova-compute[75340]:     </interface>
Nov 30 09:17:12 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:17:12 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/console.log" append="off"/>
Nov 30 09:17:12 user nova-compute[75340]:     </serial>
Nov 30 09:17:12 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:17:12 user nova-compute[75340]:     <video>
Nov 30 09:17:12 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:12 user nova-compute[75340]:     </video>
Nov 30 09:17:12 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:17:12 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:17:12 user nova-compute[75340]:     </rng>
Nov 30 09:17:12 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:17:12 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:17:12 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:17:12 user nova-compute[75340]:     </memballoon>
Nov 30 09:17:12 user nova-compute[75340]:   </devices>
Nov 30 09:17:12 user nova-compute[75340]: </domain>
Nov 30 09:17:12 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-311998467',display_name='tempest-VolumesAdminNegativeTest-server-311998467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-311998467',id=16,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-9z0i7p45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:10Z,user_data=None,user_id='a5b50ed776a541748fbfc920306c4f43',uuid=775afdeb-983c-44cf-be40-ad56aa1ab226,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG os_vif [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0be5b150-8967-54ad-9cc5-9f7309d075c2', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap316c6d06-b7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap316c6d06-b7, col_values=(('qos', UUID('02ce5777-707e-4feb-a5ac-4b52e18a4115')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap316c6d06-b7, col_values=(('external_ids', {'iface-id': '316c6d06-b71e-4282-afa1-6476ae783519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b7:66', 'vm-uuid': '775afdeb-983c-44cf-be40-ad56aa1ab226'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:12 user nova-compute[75340]: INFO os_vif [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7')
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] No VIF found with MAC fa:16:3e:9c:b7:66, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Updated VIF entry in instance network info cache for port 316c6d06-b71e-4282-afa1-6476ae783519. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Updating instance_info_cache with network_info: [{"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c651a1b9-e7f0-457a-aa7c-a3935d4874ca req-bd667e34-5206-4545-9d2c-dcb33a83a32c service nova] Releasing lock "refresh_cache-775afdeb-983c-44cf-be40-ad56aa1ab226" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] No waiting events found dispatching network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:13 user nova-compute[75340]: WARNING nova.compute.manager [req-4c2e8a32-e5cb-495c-9570-49ef226a1803 req-0ff30f24-e0a5-49df-ae02-7da5a58d186c service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received unexpected event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 for instance with vm_state building and task_state spawning.
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Waiting for libvirt event about the detach of device tapf71c5627-23 with device alias net1 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 is timed out.
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface> {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:76:31:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf71c5627-23"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 09:17:15 user nova-compute[75340]:   <name>instance-00000009</name>
Nov 30 09:17:15 user nova-compute[75340]:   <uuid>8737b5bb-6bdb-4293-bae8-3857aded9074</uuid>
Nov 30 09:17:15 user nova-compute[75340]:   <metadata>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:15 user nova-compute[75340]:   <nova:package version="0.0.0"/>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:name>tempest-device-tagging-server-2065242471</nova:name>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:creationTime>2023-11-30 09:16:08</nova:creationTime>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:flavor name="m1.tiny">
Nov 30 09:17:15 user nova-compute[75340]:     <nova:memory>512</nova:memory>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:disk>1</nova:disk>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:swap>0</nova:swap>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:flavor>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:owner>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:user uuid="94ee8b1b90db42768cc3ee61d1454f58">tempest-TaggedAttachmentsTest-716106286-project-member</nova:user>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:project uuid="e4ec812897b740438e7f8c6aaf1f245c">tempest-TaggedAttachmentsTest-716106286</nova:project>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:owner>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:ports>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:port uuid="9ec18e6c-a83d-430b-bf00-0719c095b253">
Nov 30 09:17:15 user nova-compute[75340]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:17:15 user nova-compute[75340]:     </nova:port>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:port uuid="f71c5627-2342-4438-b804-028e19d9fd25">
Nov 30 09:17:15 user nova-compute[75340]:       <nova:ip type="fixed" address="10.10.10.59" ipVersion="4"/>
Nov 30 09:17:15 user nova-compute[75340]:     </nova:port>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:ports>
Nov 30 09:17:15 user nova-compute[75340]: </nova:instance>
Nov 30 09:17:15 user nova-compute[75340]:   </metadata>
Nov 30 09:17:15 user nova-compute[75340]:   <memory unit='KiB'>524288</memory>
Nov 30 09:17:15 user nova-compute[75340]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 09:17:15 user nova-compute[75340]:   <vcpu placement='static'>1</vcpu>
Nov 30 09:17:15 user nova-compute[75340]:   <resource>
Nov 30 09:17:15 user nova-compute[75340]:     <partition>/machine</partition>
Nov 30 09:17:15 user nova-compute[75340]:   </resource>
Nov 30 09:17:15 user nova-compute[75340]:   <sysinfo type='smbios'>
Nov 30 09:17:15 user nova-compute[75340]:     <system>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='version'>0.0.0</entry>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='serial'>8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='uuid'>8737b5bb-6bdb-4293-bae8-3857aded9074</entry>
Nov 30 09:17:15 user nova-compute[75340]:       <entry name='family'>Virtual Machine</entry>
Nov 30 09:17:15 user nova-compute[75340]:     </system>
Nov 30 09:17:15 user nova-compute[75340]:   </sysinfo>
Nov 30 09:17:15 user nova-compute[75340]:   <os>
Nov 30 09:17:15 user nova-compute[75340]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 09:17:15 user nova-compute[75340]:     <boot dev='hd'/>
Nov 30 09:17:15 user nova-compute[75340]:     <smbios mode='sysinfo'/>
Nov 30 09:17:15 user nova-compute[75340]:   </os>
Nov 30 09:17:15 user nova-compute[75340]:   <features>
Nov 30 09:17:15 user nova-compute[75340]:     <acpi/>
Nov 30 09:17:15 user nova-compute[75340]:     <apic/>
Nov 30 09:17:15 user nova-compute[75340]:     <vmcoreinfo state='on'/>
Nov 30 09:17:15 user nova-compute[75340]:   </features>
Nov 30 09:17:15 user nova-compute[75340]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 09:17:15 user nova-compute[75340]:     <model fallback='forbid'>Nehalem</model>
Nov 30 09:17:15 user nova-compute[75340]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 09:17:15 user nova-compute[75340]:     <feature policy='require' name='vme'/>
Nov 30 09:17:15 user nova-compute[75340]:     <feature policy='require' name='x2apic'/>
Nov 30 09:17:15 user nova-compute[75340]:     <feature policy='require' name='hypervisor'/>
Nov 30 09:17:15 user nova-compute[75340]:   </cpu>
Nov 30 09:17:15 user nova-compute[75340]:   <clock offset='utc'>
Nov 30 09:17:15 user nova-compute[75340]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 09:17:15 user nova-compute[75340]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 09:17:15 user nova-compute[75340]:     <timer name='hpet' present='no'/>
Nov 30 09:17:15 user nova-compute[75340]:   </clock>
Nov 30 09:17:15 user nova-compute[75340]:   <on_poweroff>destroy</on_poweroff>
Nov 30 09:17:15 user nova-compute[75340]:   <on_reboot>restart</on_reboot>
Nov 30 09:17:15 user nova-compute[75340]:   <on_crash>destroy</on_crash>
Nov 30 09:17:15 user nova-compute[75340]:   <devices>
Nov 30 09:17:15 user nova-compute[75340]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 09:17:15 user nova-compute[75340]:     <disk type='file' device='disk'>
Nov 30 09:17:15 user nova-compute[75340]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 09:17:15 user nova-compute[75340]:       <source file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk' index='2'/>
Nov 30 09:17:15 user nova-compute[75340]:       <backingStore type='file' index='3'>
Nov 30 09:17:15 user nova-compute[75340]:         <format type='raw'/>
Nov 30 09:17:15 user nova-compute[75340]:         <source file='/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb'/>
Nov 30 09:17:15 user nova-compute[75340]:         <backingStore/>
Nov 30 09:17:15 user nova-compute[75340]:       </backingStore>
Nov 30 09:17:15 user nova-compute[75340]:       <target dev='vda' bus='virtio'/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='virtio-disk0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </disk>
Nov 30 09:17:15 user nova-compute[75340]:     <disk type='file' device='cdrom'>
Nov 30 09:17:15 user nova-compute[75340]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 09:17:15 user nova-compute[75340]:       <source file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk.config' index='1'/>
Nov 30 09:17:15 user nova-compute[75340]:       <backingStore/>
Nov 30 09:17:15 user nova-compute[75340]:       <target dev='hda' bus='ide'/>
Nov 30 09:17:15 user nova-compute[75340]:       <readonly/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='ide0-0-0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </disk>
Nov 30 09:17:15 user nova-compute[75340]:     <controller type='usb' index='0' model='none'>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='usb'/>
Nov 30 09:17:15 user nova-compute[75340]:     </controller>
Nov 30 09:17:15 user nova-compute[75340]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='pci.0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </controller>
Nov 30 09:17:15 user nova-compute[75340]:     <controller type='ide' index='0'>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='ide'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 09:17:15 user nova-compute[75340]:     </controller>
Nov 30 09:17:15 user nova-compute[75340]:     <interface type='ethernet'>
Nov 30 09:17:15 user nova-compute[75340]:       <mac address='fa:16:3e:b5:e3:d1'/>
Nov 30 09:17:15 user nova-compute[75340]:       <target dev='tap9ec18e6c-a8'/>
Nov 30 09:17:15 user nova-compute[75340]:       <model type='virtio'/>
Nov 30 09:17:15 user nova-compute[75340]:       <mtu size='1442'/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='net0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </interface>
Nov 30 09:17:15 user nova-compute[75340]:     <serial type='pty'>
Nov 30 09:17:15 user nova-compute[75340]:       <source path='/dev/pts/9'/>
Nov 30 09:17:15 user nova-compute[75340]:       <log file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log' append='off'/>
Nov 30 09:17:15 user nova-compute[75340]:       <target type='isa-serial' port='0'>
Nov 30 09:17:15 user nova-compute[75340]:         <model name='isa-serial'/>
Nov 30 09:17:15 user nova-compute[75340]:       </target>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='serial0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </serial>
Nov 30 09:17:15 user nova-compute[75340]:     <console type='pty' tty='/dev/pts/9'>
Nov 30 09:17:15 user nova-compute[75340]:       <source path='/dev/pts/9'/>
Nov 30 09:17:15 user nova-compute[75340]:       <log file='/opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/console.log' append='off'/>
Nov 30 09:17:15 user nova-compute[75340]:       <target type='serial' port='0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='serial0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </console>
Nov 30 09:17:15 user nova-compute[75340]:     <input type='mouse' bus='ps2'>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='input0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </input>
Nov 30 09:17:15 user nova-compute[75340]:     <input type='keyboard' bus='ps2'>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='input1'/>
Nov 30 09:17:15 user nova-compute[75340]:     </input>
Nov 30 09:17:15 user nova-compute[75340]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 09:17:15 user nova-compute[75340]:       <listen type='address' address='0.0.0.0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </graphics>
Nov 30 09:17:15 user nova-compute[75340]:     <audio id='1' type='none'/>
Nov 30 09:17:15 user nova-compute[75340]:     <video>
Nov 30 09:17:15 user nova-compute[75340]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='video0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </video>
Nov 30 09:17:15 user nova-compute[75340]:     <memballoon model='virtio'>
Nov 30 09:17:15 user nova-compute[75340]:       <stats period='10'/>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='balloon0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </memballoon>
Nov 30 09:17:15 user nova-compute[75340]:     <rng model='virtio'>
Nov 30 09:17:15 user nova-compute[75340]:       <backend model='random'>/dev/urandom</backend>
Nov 30 09:17:15 user nova-compute[75340]:       <alias name='rng0'/>
Nov 30 09:17:15 user nova-compute[75340]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 09:17:15 user nova-compute[75340]:     </rng>
Nov 30 09:17:15 user nova-compute[75340]:   </devices>
Nov 30 09:17:15 user nova-compute[75340]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 09:17:15 user nova-compute[75340]:     <label>libvirt-8737b5bb-6bdb-4293-bae8-3857aded9074</label>
Nov 30 09:17:15 user nova-compute[75340]:     <imagelabel>libvirt-8737b5bb-6bdb-4293-bae8-3857aded9074</imagelabel>
Nov 30 09:17:15 user nova-compute[75340]:   </seclabel>
Nov 30 09:17:15 user nova-compute[75340]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 09:17:15 user nova-compute[75340]:     <label>+64055:+108</label>
Nov 30 09:17:15 user nova-compute[75340]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 09:17:15 user nova-compute[75340]:   </seclabel>
Nov 30 09:17:15 user nova-compute[75340]: </domain>
Nov 30 09:17:15 user nova-compute[75340]:  {{(pid=75340) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 09:17:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully detached device tapf71c5627-23 from instance 8737b5bb-6bdb-4293-bae8-3857aded9074 from the live domain config.
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "f71c5627-2342-4438-b804-028e19d9fd25", "address": "fa:16:3e:76:31:09", "network": {"id": "ef2255db-4ce8-4066-9820-373b9bce7f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1571315349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71c5627-23", "ovs_interfaceid": "f71c5627-2342-4438-b804-028e19d9fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG os_vif [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf71c5627-23, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe35cfdf-e4ce-4a46-936c-9d6795cac312) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:15 user nova-compute[75340]: INFO os_vif [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:31:09,bridge_name='br-int',has_traffic_filtering=True,id=f71c5627-2342-4438-b804-028e19d9fd25,network=Network(ef2255db-4ce8-4066-9820-373b9bce7f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71c5627-23')
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:15 user nova-compute[75340]:   <nova:package version="0.0.0"/>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:name>tempest-device-tagging-server-2065242471</nova:name>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:creationTime>2023-11-30 09:17:15</nova:creationTime>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:flavor name="m1.tiny">
Nov 30 09:17:15 user nova-compute[75340]:     <nova:memory>512</nova:memory>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:disk>1</nova:disk>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:swap>0</nova:swap>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:flavor>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:owner>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:user uuid="94ee8b1b90db42768cc3ee61d1454f58">tempest-TaggedAttachmentsTest-716106286-project-member</nova:user>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:project uuid="e4ec812897b740438e7f8c6aaf1f245c">tempest-TaggedAttachmentsTest-716106286</nova:project>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:owner>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:15 user nova-compute[75340]:   <nova:ports>
Nov 30 09:17:15 user nova-compute[75340]:     <nova:port uuid="9ec18e6c-a83d-430b-bf00-0719c095b253">
Nov 30 09:17:15 user nova-compute[75340]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:17:15 user nova-compute[75340]:     </nova:port>
Nov 30 09:17:15 user nova-compute[75340]:   </nova:ports>
Nov 30 09:17:15 user nova-compute[75340]: </nova:instance>
Nov 30 09:17:15 user nova-compute[75340]:  {{(pid=75340) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:17:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Instance spawned successfully.
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] No waiting events found dispatching network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:15 user nova-compute[75340]: WARNING nova.compute.manager [req-00a0c3de-d347-41db-a1a9-d1391e7c1c95 req-0179c886-554e-42a8-acb1-e6d54862dd70 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received unexpected event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 for instance with vm_state building and task_state spawning.
Nov 30 09:17:15 user nova-compute[75340]: INFO nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 30 09:17:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:17:16 user nova-compute[75340]: INFO nova.compute.manager [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Took 6.49 seconds to build instance.
Nov 30 09:17:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6d6d6af0-3830-4b9e-aed0-04d451a86ecd tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquired lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:16 user nova-compute[75340]: INFO nova.network.neutron [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Port f71c5627-2342-4438-b804-028e19d9fd25 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 30 09:17:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [{"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Releasing lock "refresh_cache-8737b5bb-6bdb-4293-bae8-3857aded9074" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9dab6e71-2253-405d-8c73-1e8f973c8ceb tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "interface-8737b5bb-6bdb-4293-bae8-3857aded9074-f71c5627-2342-4438-b804-028e19d9fd25" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.770s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-5313b871-d1b5-40fb-af87-39c2e430775a req-80efe749-6764-44e8-ba43-4abff32c0929 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-deleted-f71c5627-2342-4438-b804-028e19d9fd25 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:20 user nova-compute[75340]: INFO nova.compute.manager [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Terminating instance
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:17:20 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef858fe4-a912-4729-9f48-11e473364f13 is timed out.
Nov 30 09:17:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Successfully detached device vdb from instance ef858fe4-a912-4729-9f48-11e473364f13 from the live domain config.
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmoMVRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:20 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d176cc7b-ec7a-4496-9037-a65b8727c7f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:17:20 user nova-compute[75340]: No targets found.
Nov 30 09:17:20 user nova-compute[75340]: iSNS:
Nov 30 09:17:20 user nova-compute[75340]: No targets found.
Nov 30 09:17:20 user nova-compute[75340]: STATIC:
Nov 30 09:17:20 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:17:20 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:20 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:20 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:17:20 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:20 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:20 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b
Nov 30 09:17:20 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:20 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:20 user nova-compute[75340]: FIRMWARE:
Nov 30 09:17:20 user nova-compute[75340]: No targets found.
Nov 30 09:17:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:17:20 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:17:20 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[de847cae-da52-4508-966d-a8446f06f87e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eee98b-7139-4c61-9eab-bf0ea781b946]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:20 user nova-compute[75340]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:20 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b (non-flash)
Nov 30 09:17:20 user nova-compute[75340]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:20 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50fe9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce17ca28-e332-48b5-9a1a-fa31d529e631]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d28ccb-0b2c-47ee-b665-dff1fd3e85da]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d4213-c1bd-4035-acff-ee038f91f27f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c072d-12a1-499f-a5b1-9415bca07195]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7fd951-e223-4896-b7c1-73099d6f3759]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-unplugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] No waiting events found dispatching network-vif-unplugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-0025a535-e9db-4d87-884d-7b91de177b3b req-54a1cc4e-f47c-446b-8d95-cd01da084baf service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-unplugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8293604f-0083-4f92-860b-54577e80370b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260]
Nov 30 09:17:20 user nova-compute[75340]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b, portal: 172.16.0.220,3260] successful.
Nov 30 09:17:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c9a9f8-4a7e-4cb6-87a0-6073a43c5b1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfc993-4d8f-4048-af64-4df253e4c071]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] <== disconnect_volume: return (376ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:17:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:17:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Instance destroyed successfully.
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lazy-loading 'resources' on Instance uuid fc62bd95-5c8b-49e6-b256-d0db7e20f778 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1355314172',display_name='tempest-ServersNegativeTestJSON-server-1355314172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1355314172',id=13,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-uf0di8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:40Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=fc62bd95-5c8b-49e6-b256-d0db7e20f778,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "address": "fa:16:3e:1d:f3:33", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0944cc1e-80", "ovs_interfaceid": "0944cc1e-80be-484d-b85f-8efdc5b9a44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG os_vif [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0944cc1e-80, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ff09deb-0047-4c3f-8722-be86a7e18a75) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:21 user nova-compute[75340]: INFO os_vif [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:33,bridge_name='br-int',has_traffic_filtering=True,id=0944cc1e-80be-484d-b85f-8efdc5b9a44c,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0944cc1e-80')
Nov 30 09:17:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Deleting instance files /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778_del
Nov 30 09:17:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Deletion of /opt/stack/data/nova/instances/fc62bd95-5c8b-49e6-b256-d0db7e20f778_del complete
Nov 30 09:17:21 user nova-compute[75340]: INFO nova.compute.manager [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 09:17:21 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lazy-loading 'flavor' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a91ab75-d0a1-4995-8564-eb685a7b52f2 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:21 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Took 0.50 seconds to deallocate network for instance.
Nov 30 09:17:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:22 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Deleted allocations for instance fc62bd95-5c8b-49e6-b256-d0db7e20f778
Nov 30 09:17:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-28a9205e-9edc-4c0a-a907-1afe8f782cc0 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] Acquiring lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] Lock "fc62bd95-5c8b-49e6-b256-d0db7e20f778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] No waiting events found dispatching network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:22 user nova-compute[75340]: WARNING nova.compute.manager [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received unexpected event network-vif-plugged-0944cc1e-80be-484d-b85f-8efdc5b9a44c for instance with vm_state deleted and task_state None.
Nov 30 09:17:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-612a0b3e-30bb-4dbe-9297-49c51d9d98c2 req-771cc7fd-a11a-4553-b093-0853d2300fbd service nova] [instance: fc62bd95-5c8b-49e6-b256-d0db7e20f778] Received event network-vif-deleted-0944cc1e-80be-484d-b85f-8efdc5b9a44c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:23 user nova-compute[75340]: INFO nova.compute.manager [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Terminating instance
Nov 30 09:17:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-unplugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] No waiting events found dispatching network-vif-unplugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-96607d5c-6146-4cb6-b831-ab9653ce522b req-18dcedfa-437f-46bf-963d-6fa673a987c2 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-unplugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Instance destroyed successfully.
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.objects.instance [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lazy-loading 'resources' on Instance uuid 96cb8988-b8a9-46f8-903a-29f26dfaba1c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1110503839',display_name='tempest-VolumesAssistedSnapshotsTest-server-1110503839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1110503839',id=11,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiIGi/0wQXB9VmtWd4sR5Yz1y/NkI8gM1Yq2VHbJYAD5b8pOPJHEnueVG6kVHVfXmdOjS2lUgT7IbY78W9uYrZN0BRGXIg6Jm1/GTmCxtRKcLe2Pb/MxXRXx6ErVYfgvA==',key_name='tempest-keypair-1917757242',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdae7248c564f9db914033cb93ed716',ramdisk_id='',reservation_id='r-58xyonsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-765787768',owner_user_name='tempest-VolumesAssistedSnapshotsTest-765787768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d6ea228a4e47b8b8b925e39394f1c1',uuid=96cb8988-b8a9-46f8-903a-29f26dfaba1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converting VIF {"id": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "address": "fa:16:3e:aa:22:d5", "network": {"id": "45e2336d-673f-4ec8-9ed1-9eb21e7c8692", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-498707361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdae7248c564f9db914033cb93ed716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3b34-0f", "ovs_interfaceid": "64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG os_vif [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ae3b34-0f, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f884d402-bf98-44d8-a998-a7d383c2a94a) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: INFO os_vif [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:22:d5,bridge_name='br-int',has_traffic_filtering=True,id=64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e,network=Network(45e2336d-673f-4ec8-9ed1-9eb21e7c8692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3b34-0f')
Nov 30 09:17:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Deleting instance files /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c_del
Nov 30 09:17:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Deletion of /opt/stack/data/nova/instances/96cb8988-b8a9-46f8-903a-29f26dfaba1c_del complete
Nov 30 09:17:24 user nova-compute[75340]: INFO nova.compute.manager [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 30 09:17:24 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:25 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Took 0.98 seconds to deallocate network for instance.
Nov 30 09:17:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-1eefb13c-a4a7-4016-b217-9eec4568acf6 req-92094397-cc69-401a-8b39-e1bf44f562bb service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-deleted-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:25 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Deleted allocations for instance 96cb8988-b8a9-46f8-903a-29f26dfaba1c
Nov 30 09:17:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dbf2e5cf-74c5-468b-9065-a9f7a2efab2b tempest-VolumesAssistedSnapshotsTest-765787768 tempest-VolumesAssistedSnapshotsTest-765787768-project-member] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] Acquiring lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] Lock "96cb8988-b8a9-46f8-903a-29f26dfaba1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] No waiting events found dispatching network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:26 user nova-compute[75340]: WARNING nova.compute.manager [req-9fb3a715-4cd4-4a90-9a2c-3e155b3fd0a8 req-409be55f-1336-4d48-bfb2-780ad6bc1789 service nova] [instance: 96cb8988-b8a9-46f8-903a-29f26dfaba1c] Received unexpected event network-vif-plugged-64ae3b34-0f38-450d-b9e2-5b4d2cb81b8e for instance with vm_state deleted and task_state None.
Nov 30 09:17:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'flavor' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:32 user nova-compute[75340]: INFO nova.compute.manager [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Attaching volume efd4dbce-d836-491d-9109-cf96338dbcaf to /dev/vdb
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.utils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd75104-c216-49bc-a830-6e490e63882b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[113dc01a-df1c-4146-9524-56d05c8b2423]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c7e1c3-48ac-4fad-853e-ef0284f1ae73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a684c18-5b6c-4821-ac4e-c485555c6b79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:17:32 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[08adb8a9-5064-4c72-bc63-fd1010d29a5b]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG os_brick.utils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating existing volume attachment record: 10e37695-634b-4b7f-a1fe-c24070d78997 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating instance_info_cache with network_info: [{"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-30737691-a43b-44ec-93c2-b66868d553ac" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:33 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:17:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:17:35 user nova-compute[75340]: INFO nova.compute.claims [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Claim successful on node user
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:17:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.policy [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f498547afe8147f8b449af9ed8e88977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8038735fb054b7594ecc999f8a1bd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:17:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Creating image(s)
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "/opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "/opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Successfully created port: 4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Cannot resize image /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Ensure instance console log exists: /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:36 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Successfully updated port: 4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquired lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-changed-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Refreshing instance network info cache due to event network-changed-4b66c617-632c-4a02-9820-6af836ca78ab. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] Acquiring lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:17:37 user nova-compute[75340]: INFO nova.compute.claims [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Claim successful on node user
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating instance_info_cache with network_info: [{"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Releasing lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Instance network_info: |[{"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] Acquired lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.neutron [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Refreshing network info cache for port 4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Start _get_guest_xml network_info=[{"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:17:37 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:37 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1786363411',display_name='tempest-TestServerVolumeAttachmentScenario-server-1786363411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1786363411',id=17,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqSJAPEVChQEFg+gKCu8zHhkUH/WAzWIBKFxEg0wr4jshjAyiYxdc5/kQnDQKd8rCeXSxc64fWSpYxD0uBAV5UYtQPu8cdGu0p8u9d4kc2SOKA84UPAZb00tuiINvdjw==',key_name='tempest-keypair-497003295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8038735fb054b7594ecc999f8a1bd1b',ramdisk_id='',reservation_id='r-z5hlp821',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444957444',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444957444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f498547afe8147f8b449af9ed8e88977',uuid=2c5351f7-c57f-4b35-8642-3a124259bef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converting VIF {"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:17:37 user nova-compute[75340]:   <uuid>2c5351f7-c57f-4b35-8642-3a124259bef7</uuid>
Nov 30 09:17:37 user nova-compute[75340]:   <name>instance-00000011</name>
Nov 30 09:17:37 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:17:37 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:17:37 user nova-compute[75340]:   <metadata>
Nov 30 09:17:37 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:37 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1786363411</nova:name>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:17:37</nova:creationTime>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:17:37 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:37 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:owner>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:user uuid="f498547afe8147f8b449af9ed8e88977">tempest-TestServerVolumeAttachmentScenario-444957444-project-member</nova:user>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:project uuid="b8038735fb054b7594ecc999f8a1bd1b">tempest-TestServerVolumeAttachmentScenario-444957444</nova:project>
Nov 30 09:17:37 user nova-compute[75340]:       </nova:owner>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:37 user nova-compute[75340]:       <nova:ports>
Nov 30 09:17:37 user nova-compute[75340]:         <nova:port uuid="4b66c617-632c-4a02-9820-6af836ca78ab">
Nov 30 09:17:37 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:17:37 user nova-compute[75340]:         </nova:port>
Nov 30 09:17:37 user nova-compute[75340]:       </nova:ports>
Nov 30 09:17:37 user nova-compute[75340]:     </nova:instance>
Nov 30 09:17:37 user nova-compute[75340]:   </metadata>
Nov 30 09:17:37 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:17:37 user nova-compute[75340]:     <system>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="serial">2c5351f7-c57f-4b35-8642-3a124259bef7</entry>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="uuid">2c5351f7-c57f-4b35-8642-3a124259bef7</entry>
Nov 30 09:17:37 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:17:37 user nova-compute[75340]:     </system>
Nov 30 09:17:37 user nova-compute[75340]:   </sysinfo>
Nov 30 09:17:37 user nova-compute[75340]:   <os>
Nov 30 09:17:37 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:17:37 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:17:37 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:17:37 user nova-compute[75340]:   </os>
Nov 30 09:17:37 user nova-compute[75340]:   <features>
Nov 30 09:17:37 user nova-compute[75340]:     <acpi/>
Nov 30 09:17:37 user nova-compute[75340]:     <apic/>
Nov 30 09:17:37 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:17:37 user nova-compute[75340]:   </features>
Nov 30 09:17:37 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:17:37 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:17:37 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:17:37 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:17:37 user nova-compute[75340]:   </clock>
Nov 30 09:17:37 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:17:37 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:17:37 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:17:37 user nova-compute[75340]:   </cpu>
Nov 30 09:17:37 user nova-compute[75340]:   <devices>
Nov 30 09:17:37 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:17:37 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:17:37 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk"/>
Nov 30 09:17:37 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:17:37 user nova-compute[75340]:     </disk>
Nov 30 09:17:37 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:17:37 user nova-compute[75340]:       <mac address="fa:16:3e:0c:2f:e4"/>
Nov 30 09:17:37 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:37 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:17:37 user nova-compute[75340]:       <target dev="tap4b66c617-63"/>
Nov 30 09:17:37 user nova-compute[75340]:     </interface>
Nov 30 09:17:37 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:17:37 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/console.log" append="off"/>
Nov 30 09:17:37 user nova-compute[75340]:     </serial>
Nov 30 09:17:37 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:17:37 user nova-compute[75340]:     <video>
Nov 30 09:17:37 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:37 user nova-compute[75340]:     </video>
Nov 30 09:17:37 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:17:37 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:17:37 user nova-compute[75340]:     </rng>
Nov 30 09:17:37 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:17:37 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:17:37 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:17:37 user nova-compute[75340]:     </memballoon>
Nov 30 09:17:37 user nova-compute[75340]:   </devices>
Nov 30 09:17:37 user nova-compute[75340]: </domain>
Nov 30 09:17:37 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1786363411',display_name='tempest-TestServerVolumeAttachmentScenario-server-1786363411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1786363411',id=17,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqSJAPEVChQEFg+gKCu8zHhkUH/WAzWIBKFxEg0wr4jshjAyiYxdc5/kQnDQKd8rCeXSxc64fWSpYxD0uBAV5UYtQPu8cdGu0p8u9d4kc2SOKA84UPAZb00tuiINvdjw==',key_name='tempest-keypair-497003295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8038735fb054b7594ecc999f8a1bd1b',ramdisk_id='',reservation_id='r-z5hlp821',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444957444',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444957444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f498547afe8147f8b449af9ed8e88977',uuid=2c5351f7-c57f-4b35-8642-3a124259bef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converting VIF {"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG os_vif [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81a9bb72-b1cb-508e-bae4-9ce3231c32ed', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b66c617-63, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b66c617-63, col_values=(('qos', UUID('036d159c-8828-4fc7-96f7-0e9a7b8f908f')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b66c617-63, col_values=(('external_ids', {'iface-id': '4b66c617-632c-4a02-9820-6af836ca78ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:2f:e4', 'vm-uuid': '2c5351f7-c57f-4b35-8642-3a124259bef7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:37 user nova-compute[75340]: INFO os_vif [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63')
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No VIF found with MAC fa:16:3e:0c:2f:e4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.network.neutron [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updated VIF entry in instance network info cache for port 4b66c617-632c-4a02-9820-6af836ca78ab. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.network.neutron [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating instance_info_cache with network_info: [{"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-921b9336-60b8-4e09-99ca-cc012277fd6e req-a3159473-1a75-42e6-aca0-c19c2d9e3040 service nova] Releasing lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.991s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:17:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.policy [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61fabd845c2a4368bab99d4ca469452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2a93601bf545c7b13b34afc2c0da24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:17:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Creating image(s)
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk 1073741824" returned: 0 in 0.080s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Successfully created port: 738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Cannot resize image /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Ensure instance console log exists: /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] No waiting events found dispatching network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:40 user nova-compute[75340]: WARNING nova.compute.manager [req-2e0098c5-bc78-4445-a6ff-175459d8740a req-4546833a-22db-40f1-811b-538637542f7f service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received unexpected event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab for instance with vm_state building and task_state spawning.
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Successfully updated port: 738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-changed-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Refreshing instance network info cache due to event network-changed-738e3ea5-c7f7-4353-8a1f-a5c9115cb244. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] Acquiring lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating instance_info_cache with network_info: [{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance network_info: |[{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] Acquired lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Refreshing network info cache for port 738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start _get_guest_xml network_info=[{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:17:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-tempest.common.compute-instance-225583100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'pci_devices' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:17:40 user nova-compute[75340]:   <uuid>9455558a-7e24-449d-a515-436c818bf5c4</uuid>
Nov 30 09:17:40 user nova-compute[75340]:   <name>instance-00000012</name>
Nov 30 09:17:40 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:17:40 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:17:40 user nova-compute[75340]:   <metadata>
Nov 30 09:17:40 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:17:40 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:name>tempest-tempest.common.compute-instance-225583100</nova:name>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:17:40</nova:creationTime>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:17:40 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:17:40 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:owner>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:user uuid="61fabd845c2a4368bab99d4ca469452a">tempest-ServerActionsTestOtherA-1563000763-project-member</nova:user>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:project uuid="5c2a93601bf545c7b13b34afc2c0da24">tempest-ServerActionsTestOtherA-1563000763</nova:project>
Nov 30 09:17:40 user nova-compute[75340]:       </nova:owner>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:17:40 user nova-compute[75340]:       <nova:ports>
Nov 30 09:17:40 user nova-compute[75340]:         <nova:port uuid="738e3ea5-c7f7-4353-8a1f-a5c9115cb244">
Nov 30 09:17:40 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:17:40 user nova-compute[75340]:         </nova:port>
Nov 30 09:17:40 user nova-compute[75340]:       </nova:ports>
Nov 30 09:17:40 user nova-compute[75340]:     </nova:instance>
Nov 30 09:17:40 user nova-compute[75340]:   </metadata>
Nov 30 09:17:40 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:17:40 user nova-compute[75340]:     <system>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="serial">9455558a-7e24-449d-a515-436c818bf5c4</entry>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="uuid">9455558a-7e24-449d-a515-436c818bf5c4</entry>
Nov 30 09:17:40 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:17:40 user nova-compute[75340]:     </system>
Nov 30 09:17:40 user nova-compute[75340]:   </sysinfo>
Nov 30 09:17:40 user nova-compute[75340]:   <os>
Nov 30 09:17:40 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:17:40 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:17:40 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:17:40 user nova-compute[75340]:   </os>
Nov 30 09:17:40 user nova-compute[75340]:   <features>
Nov 30 09:17:40 user nova-compute[75340]:     <acpi/>
Nov 30 09:17:40 user nova-compute[75340]:     <apic/>
Nov 30 09:17:40 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:17:40 user nova-compute[75340]:   </features>
Nov 30 09:17:40 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:17:40 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:17:40 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:17:40 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:17:40 user nova-compute[75340]:   </clock>
Nov 30 09:17:40 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:17:40 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:17:40 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:17:40 user nova-compute[75340]:   </cpu>
Nov 30 09:17:40 user nova-compute[75340]:   <devices>
Nov 30 09:17:40 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:17:40 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:17:40 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk"/>
Nov 30 09:17:40 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:17:40 user nova-compute[75340]:     </disk>
Nov 30 09:17:40 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:17:40 user nova-compute[75340]:       <mac address="fa:16:3e:06:c9:68"/>
Nov 30 09:17:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:40 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:17:40 user nova-compute[75340]:       <target dev="tap738e3ea5-c7"/>
Nov 30 09:17:40 user nova-compute[75340]:     </interface>
Nov 30 09:17:40 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:17:40 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/console.log" append="off"/>
Nov 30 09:17:40 user nova-compute[75340]:     </serial>
Nov 30 09:17:40 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:17:40 user nova-compute[75340]:     <video>
Nov 30 09:17:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:17:40 user nova-compute[75340]:     </video>
Nov 30 09:17:40 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:17:40 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:17:40 user nova-compute[75340]:     </rng>
Nov 30 09:17:40 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:17:40 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:17:40 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:17:40 user nova-compute[75340]:     </memballoon>
Nov 30 09:17:40 user nova-compute[75340]:   </devices>
Nov 30 09:17:40 user nova-compute[75340]: </domain>
Nov 30 09:17:40 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-tempest.common.compute-instance-225583100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG os_vif [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac1f94f5-b2c0-55a5-86c6-214de1e114eb', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738e3ea5-c7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap738e3ea5-c7, col_values=(('qos', UUID('069de02b-a2d0-45dd-93a5-65ceda23f2e8')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap738e3ea5-c7, col_values=(('external_ids', {'iface-id': '738e3ea5-c7f7-4353-8a1f-a5c9115cb244', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:c9:68', 'vm-uuid': '9455558a-7e24-449d-a515-436c818bf5c4'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:40 user nova-compute[75340]: INFO os_vif [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7')
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:06:c9:68, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updated VIF entry in instance network info cache for port 738e3ea5-c7f7-4353-8a1f-a5c9115cb244. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating instance_info_cache with network_info: [{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-efc0dbdc-e12c-4176-9ca5-a08039f6ab0b req-5a8d6a76-20cb-445c-9627-f9ddd80d1b4a service nova] Releasing lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] No waiting events found dispatching network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING nova.compute.manager [req-003ca6c3-2eee-4a1e-bb82-eeb93cd8dc37 req-69a3a85a-cf06-4b2e-ab3c-375f7d6d89c8 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received unexpected event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab for instance with vm_state building and task_state spawning.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state building and task_state spawning.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING nova.compute.manager [req-28ebc24f-df94-4456-a162-430104820bc9 req-a06e002e-0fb6-4ff9-9f88-9d71db0f83c7 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state building and task_state spawning.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:44 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Instance spawned successfully.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:17:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.4794921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance spawned successfully.
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791ed5e-54e8-4fed-ac20-6ad575e17ef6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:17:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[695fbcdc-e7da-42e5-8092-fe3c87953b78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30dadf-42ff-435d-a193-7c184edecc40]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[94440529-c47a-4611-90cd-ae2aa54f5155]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef1c0b-7580-4da3-8b38-cdae709db489]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StPFBMKc'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: INFO nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Took 9.22 seconds to spawn the instance on the hypervisor.
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff45fc-f0af-49bc-8072-227a45bd6ad8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 30737691-a43b-44ec-93c2-b66868d553ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8737b5bb-6bdb-4293-bae8-3857aded9074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance ef858fe4-a912-4729-9f48-11e473364f13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9df69524-d3db-4d24-aaa4-f08efdf7c7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 775afdeb-983c-44cf-be40-ad56aa1ab226 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb3e3c-1d5c-4f5d-89bf-9a1de2406440]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:45 user nova-compute[75340]: INFO nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: INFO nova.compute.manager [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Took 10.21 seconds to build instance.
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc49105-89dc-463a-a49f-53b83037d7be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:17:45 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4fffea8e-427d-43b6-8095-2606bd346023 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.318s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2012bb39-4256-4c5b-9e4f-b1bd08a9218c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1e3d88-b8da-4b60-bd33-40634cec9408]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:17:45 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:17:45 user nova-compute[75340]: INFO nova.compute.manager [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Took 8.15 seconds to build instance.
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5047db-0d82-4dec-8f8e-ebbfdd61a510]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7e7caefc-557e-4572-83dd-6c5e17dd9025 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.313s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:17:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.932s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:46 user nova-compute[75340]: INFO nova.compute.manager [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Terminating instance
Nov 30 09:17:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'flavor' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:17:46 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:17:46 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:17:46 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:17:46 user nova-compute[75340]:   <serial>efd4dbce-d836-491d-9109-cf96338dbcaf</serial>
Nov 30 09:17:46 user nova-compute[75340]: </disk>
Nov 30 09:17:46 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:17:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-unplugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-unplugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-0515a480-cc6e-4460-ba4b-473cd08c209d req-7d405db4-7ff0-4437-98d9-93b9a41da83d service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-unplugged-9ec18e6c-a83d-430b-bf00-0719c095b253 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:17:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Instance destroyed successfully.
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.objects.instance [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lazy-loading 'resources' on Instance uuid 8737b5bb-6bdb-4293-bae8-3857aded9074 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065242471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065242471',id=9,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjhHpjzo05GBZ4bxEw4AoBdPpXtum/QOgyJiQJdEeppK5ON1ll8sZBGvimShNleGyWSJG+AqGoEsEzxtHACY9UprCVyqcKNzxQZK4AwGV1hvcdn3RiIlakH0mmY3cabA==',key_name='tempest-keypair-52350330',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4ec812897b740438e7f8c6aaf1f245c',ramdisk_id='',reservation_id='r-4xq0s1hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-716106286',owner_user_name='tempest-TaggedAttachmentsTest-716106286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ee8b1b90db42768cc3ee61d1454f58',uuid=8737b5bb-6bdb-4293-bae8-3857aded9074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converting VIF {"id": "9ec18e6c-a83d-430b-bf00-0719c095b253", "address": "fa:16:3e:b5:e3:d1", "network": {"id": "2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-616627957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ec812897b740438e7f8c6aaf1f245c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ec18e6c-a8", "ovs_interfaceid": "9ec18e6c-a83d-430b-bf00-0719c095b253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG os_vif [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ec18e6c-a8, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30a913dc-4036-4c8d-9893-eb026c5b7166) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No VIF found with MAC fa:16:3e:f5:c0:76, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:17:47 user nova-compute[75340]: INFO os_vif [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e3:d1,bridge_name='br-int',has_traffic_filtering=True,id=9ec18e6c-a83d-430b-bf00-0719c095b253,network=Network(2a0e4fd6-2c3a-4e6d-87ce-aeffff51f312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ec18e6c-a8')
Nov 30 09:17:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Deleting instance files /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074_del
Nov 30 09:17:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Deletion of /opt/stack/data/nova/instances/8737b5bb-6bdb-4293-bae8-3857aded9074_del complete
Nov 30 09:17:47 user nova-compute[75340]: INFO nova.compute.manager [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 30 09:17:47 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:17:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d6641d8c-7c71-4478-b2de-afafa357741a tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.155s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-changed-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Refreshing instance network info cache due to event network-changed-8e161b24-3561-4bcd-9151-a78d869398d5. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] Acquiring lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] Acquired lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Refreshing network info cache for port 8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] Acquiring lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] No waiting events found dispatching network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:49 user nova-compute[75340]: WARNING nova.compute.manager [req-ddc9d63d-85c4-42ec-ab66-137e77c0fbe7 req-49bde7d9-b74c-4f29-84ab-792b0cd184f8 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received unexpected event network-vif-plugged-9ec18e6c-a83d-430b-bf00-0719c095b253 for instance with vm_state active and task_state deleting.
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:49 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Took 1.75 seconds to deallocate network for instance.
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:49 user nova-compute[75340]: INFO nova.compute.manager [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Terminating instance
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updated VIF entry in instance network info cache for port 8e161b24-3561-4bcd-9151-a78d869398d5. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updating instance_info_cache with network_info: [{"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2d7bac5b-52b3-477d-9435-bd1d46d95447 req-fd64cc2c-8b25-4bcc-a4b2-a61f87b3b35e service nova] Releasing lock "refresh_cache-9df69524-d3db-4d24-aaa4-f08efdf7c7a6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.730s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Deleted allocations for instance 8737b5bb-6bdb-4293-bae8-3857aded9074
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Stashing vm_state: active {{(pid=75340) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-unplugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] No waiting events found dispatching network-vif-unplugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-33ae1e1d-c91c-415c-9923-3b2f34c649c1 req-3f24e167-0fe9-4dd8-ba03-54fcf1295cab service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-unplugged-8e161b24-3561-4bcd-9151-a78d869398d5 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-451b73c2-52a8-439c-8b8f-abb8b76c0308 tempest-TaggedAttachmentsTest-716106286 tempest-TaggedAttachmentsTest-716106286-project-member] Lock "8737b5bb-6bdb-4293-bae8-3857aded9074" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.202s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.005s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.compute.manager [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Terminating instance
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Instance destroyed successfully.
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'resources' on Instance uuid 9df69524-d3db-4d24-aaa4-f08efdf7c7a6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.compute.claims [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Claim successful on node user
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291080789',display_name='tempest-AttachVolumeNegativeTest-server-1291080789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291080789',id=14,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfhcMwcJh8Pw7I94Enej1RQahWuUgh5Ti1CESMyb5C2isTu+A5/iFEUJCadZj0jC0uu9pc8Nt6X1QyVIDQVmRDd6yZbPEXxWJ61QMgwqR7JcYYl5YDmtVHZWtBfnsmszg==',key_name='tempest-keypair-190703243',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:16:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-ehbdj1ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=9df69524-d3db-4d24-aaa4-f08efdf7c7a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "8e161b24-3561-4bcd-9151-a78d869398d5", "address": "fa:16:3e:40:8c:75", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e161b24-35", "ovs_interfaceid": "8e161b24-3561-4bcd-9151-a78d869398d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG os_vif [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e161b24-35, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating resource usage from migration 39f44288-573c-4c17-944f-cd58a1a2d944
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc444c17-b5f9-4eef-85c6-2ca7028b04f1) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:50 user nova-compute[75340]: INFO os_vif [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8c:75,bridge_name='br-int',has_traffic_filtering=True,id=8e161b24-3561-4bcd-9151-a78d869398d5,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e161b24-35')
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Deleting instance files /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6_del
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Deletion of /opt/stack/data/nova/instances/9df69524-d3db-4d24-aaa4-f08efdf7c7a6_del complete
Nov 30 09:17:50 user nova-compute[75340]: INFO nova.compute.manager [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 30 09:17:50 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:17:50 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] [instance: 8737b5bb-6bdb-4293-bae8-3857aded9074] Received event network-vif-deleted-9ec18e6c-a83d-430b-bf00-0719c095b253 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-unplugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] No waiting events found dispatching network-vif-unplugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6b6a5bb-83ae-4850-b87b-72086bab619d req-57f80271-14ae-4da5-8516-2d781816c2b0 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-unplugged-4d07b2b8-9b11-4908-9f55-71ee0996123f for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Instance destroyed successfully.
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lazy-loading 'resources' on Instance uuid ef858fe4-a912-4729-9f48-11e473364f13 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1476208229',display_name='tempest-TestVolumeSwap-server-1476208229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1476208229',id=10,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQkkhl9Tdt5iF9fUwBv3VZp1KEDCC5Zt1qb91GToAg6E27ktJGYBUveu1eCnhmqDa/xaR2y/9rVpz4eMOFF8UxGEDFa17+f5M0yEU1qN1IjKB0+a/lmeWZVPgUQhf9byg==',key_name='tempest-keypair-261378391',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef8c8193bbc14d508a71f44256da1640',ramdisk_id='',reservation_id='r-g5bz5022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2068553882',owner_user_name='tempest-TestVolumeSwap-2068553882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1669dccd0871427287b8841f4482712f',uuid=ef858fe4-a912-4729-9f48-11e473364f13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converting VIF {"id": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "address": "fa:16:3e:e4:25:4f", "network": {"id": "78d341f0-8cb0-4877-8103-8051d9216be4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-719856934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8c8193bbc14d508a71f44256da1640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d07b2b8-9b", "ovs_interfaceid": "4d07b2b8-9b11-4908-9f55-71ee0996123f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG os_vif [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.873s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.compute.manager [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Migrating
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d07b2b8-9b, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.compute.rpcapi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=753f3f68-d61e-488a-bcdf-6d20f9fac3d2) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:51 user nova-compute[75340]: INFO os_vif [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d07b2b8-9b11-4908-9f55-71ee0996123f,network=Network(78d341f0-8cb0-4877-8103-8051d9216be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d07b2b8-9b')
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Deleting instance files /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13_del
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Deletion of /opt/stack/data/nova/instances/ef858fe4-a912-4729-9f48-11e473364f13_del complete
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:51 user nova-compute[75340]: INFO nova.compute.manager [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 30 09:17:51 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:17:51 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] Acquiring lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] No waiting events found dispatching network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:52 user nova-compute[75340]: WARNING nova.compute.manager [req-168c03cd-a418-4181-8cf2-5cb327a8a8f5 req-38b5e204-a7e3-4d69-b499-2d42fd8a103b service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received unexpected event network-vif-plugged-8e161b24-3561-4bcd-9151-a78d869398d5 for instance with vm_state active and task_state deleting.
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Starting migrate_disk_and_power_off {{(pid=75340) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:52 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Took 1.67 seconds to deallocate network for instance.
Nov 30 09:17:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:52 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:52 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Took 1.21 seconds to deallocate network for instance.
Nov 30 09:17:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] Acquiring lock "ef858fe4-a912-4729-9f48-11e473364f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] Lock "ef858fe4-a912-4729-9f48-11e473364f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] No waiting events found dispatching network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:53 user nova-compute[75340]: WARNING nova.compute.manager [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received unexpected event network-vif-plugged-4d07b2b8-9b11-4908-9f55-71ee0996123f for instance with vm_state deleted and task_state None.
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e8c38d8-69dc-4e1c-864c-4e0bea19604f req-d204cad2-4e53-415c-950a-c96a16e25c42 service nova] [instance: ef858fe4-a912-4729-9f48-11e473364f13] Received event network-vif-deleted-4d07b2b8-9b11-4908-9f55-71ee0996123f {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.481s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance destroyed successfully.
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4948b73b-dc, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5349791-71e4-4155-91e1-6cad191dd022) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:17:53 user nova-compute[75340]: INFO os_vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:53 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:17:53 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Deleted allocations for instance 9df69524-d3db-4d24-aaa4-f08efdf7c7a6
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[77015b2a-001f-476a-bfa1-86d3577f0c63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:17:53 user nova-compute[75340]: No targets found.
Nov 30 09:17:53 user nova-compute[75340]: iSNS:
Nov 30 09:17:53 user nova-compute[75340]: No targets found.
Nov 30 09:17:53 user nova-compute[75340]: STATIC:
Nov 30 09:17:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:17:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:17:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:17:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:17:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:17:53 user nova-compute[75340]: FIRMWARE:
Nov 30 09:17:53 user nova-compute[75340]: No targets found.
Nov 30 09:17:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:17:53 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:17:53 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e68105-7d8e-4d8f-838d-1bf7706aeca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8088f-d786-41c7-bbd8-c27dab14e1bf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:53 user nova-compute[75340]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:17:53 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:17:53 user nova-compute[75340]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:17:53 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:17:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff4814d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c7b18dde-c214-4d1d-b8d0-6b47b7d01592 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "9df69524-d3db-4d24-aaa4-f08efdf7c7a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.911s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d762820-babc-4bde-a793-c973677ef2cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be759f-fa6b-42e2-a80d-11ce7e6d8b43]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d39e044-dc33-4fd6-a1a7-8312154371fa]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb4a691-95d4-4ccb-89eb-8c4f045f2c6f]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[03921f3a-433d-4129-82d4-f1292b7d317b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f9569-7fbc-403a-a7a1-0c726c3d5e4b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:17:53 user nova-compute[75340]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:17:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f715856-e660-416c-b5fd-82daa76116d2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== disconnect_volume: return (366ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:53 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Deleted allocations for instance ef858fe4-a912-4729-9f48-11e473364f13
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79bee97e-caf6-470d-8597-1fba301be359 tempest-TestVolumeSwap-2068553882 tempest-TestVolumeSwap-2068553882-project-member] Lock "ef858fe4-a912-4729-9f48-11e473364f13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_resize/disk /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: 9df69524-d3db-4d24-aaa4-f08efdf7c7a6] Received event network-vif-deleted-8e161b24-3561-4bcd-9151-a78d869398d5 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:54 user nova-compute[75340]: WARNING nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state resize_migrating.
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:17:54 user nova-compute[75340]: WARNING nova.compute.manager [req-a7c57116-2702-4bc0-80cd-c3f1ff821853 req-0dc0ed30-91f0-45c1-9e34-d96f2ca9ac20 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state resize_migrating.
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "cp -r /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_resize/disk /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk" returned: 0 in 0.505s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_resize/disk.info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk.info {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "cp -r /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_resize/disk.info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk.info" returned: 0 in 0.037s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Port 4948b73b-dc7f-4720-8006-1232706b4aac binding to destination host user is already ACTIVE {{(pid=75340) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:17:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.utils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84134212-5d80-4465-aaf7-b33d51dfb588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb0f15-dca8-4c56-a696-a3fa86cbb6cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a25081-de9f-4c3b-9d32-7313cc61e893]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f951803-5c70-4073-a5f6-dc443e149dc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:17:59 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:17:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6d977-e800-48b0-9740-63f2b78b6eed]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:17:59 user nova-compute[75340]: DEBUG os_brick.utils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:18:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Starting finish_migration {{(pid=75340) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:18:10 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Creating image(s)
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk. size=21474836480 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk 21474836480 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk 21474836480" returned: 0 in 0.062s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Ensure instance console log exists: /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start _get_guest_xml network_info=[{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '4572d889-ec8d-4063-a1a3-0c82366e7600', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cd3f40a8-6a0f-4116-b654-e222153dd2a4', 'attached_at': '2023-11-30T09:18:10.000000', 'detached_at': '', 'volume_id': 'efd4dbce-d836-491d-9109-cf96338dbcaf', 'serial': 'efd4dbce-d836-491d-9109-cf96338dbcaf'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:18:10 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:10 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:18:10 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:18:10 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:18:10 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc9e8b-3b9d-4a9c-a379-7081cba5abec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:18:10 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569187e-3a87-4b7b-9550-a0fa95b54fa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added
Nov 30 09:18:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca0759-ea8e-4ce9-9950-68b9d1582c07]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3cdde8-0c59-43fb-8653-6dc8bb6c6f9b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4d5b0-8fb8-4b61-86e1-f446d653e7ab]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StPFBMKc'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3616e-6a32-40c7-b41c-2ddd90f2a568]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac9123-446e-4d2b-a239-e5dc6b815840]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:10 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:10 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a31ae0-6741-4eff-9925-bb544863a0fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:18:10 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:18:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b6bad8-ac63-4ead-ac64-4e481b96c90d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126e19a-6bea-4197-9258-07204a98d6ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:11 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:18:11 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:11 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:18:11 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[88585433-655e-4534-99e1-58e73e89469c]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:18:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:18:12 user nova-compute[75340]:   <uuid>cd3f40a8-6a0f-4116-b654-e222153dd2a4</uuid>
Nov 30 09:18:12 user nova-compute[75340]:   <name>instance-00000005</name>
Nov 30 09:18:12 user nova-compute[75340]:   <memory>2097152</memory>
Nov 30 09:18:12 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:18:12 user nova-compute[75340]:   <metadata>
Nov 30 09:18:12 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:18:12 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherB-server-1737055794</nova:name>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:18:10</nova:creationTime>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:flavor name="m1.small">
Nov 30 09:18:12 user nova-compute[75340]:         <nova:memory>2048</nova:memory>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:disk>20</nova:disk>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:18:12 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:owner>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:user uuid="aeac2f0e248940b1b494f96c8e7535d5">tempest-ServerActionsTestOtherB-642872739-project-member</nova:user>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:project uuid="082add99abc342f9aa296b611fd4cb85">tempest-ServerActionsTestOtherB-642872739</nova:project>
Nov 30 09:18:12 user nova-compute[75340]:       </nova:owner>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:18:12 user nova-compute[75340]:       <nova:ports>
Nov 30 09:18:12 user nova-compute[75340]:         <nova:port uuid="4948b73b-dc7f-4720-8006-1232706b4aac">
Nov 30 09:18:12 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:18:12 user nova-compute[75340]:         </nova:port>
Nov 30 09:18:12 user nova-compute[75340]:       </nova:ports>
Nov 30 09:18:12 user nova-compute[75340]:     </nova:instance>
Nov 30 09:18:12 user nova-compute[75340]:   </metadata>
Nov 30 09:18:12 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:18:12 user nova-compute[75340]:     <system>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="serial">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="uuid">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:18:12 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:18:12 user nova-compute[75340]:     </system>
Nov 30 09:18:12 user nova-compute[75340]:   </sysinfo>
Nov 30 09:18:12 user nova-compute[75340]:   <os>
Nov 30 09:18:12 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:18:12 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:18:12 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:18:12 user nova-compute[75340]:   </os>
Nov 30 09:18:12 user nova-compute[75340]:   <features>
Nov 30 09:18:12 user nova-compute[75340]:     <acpi/>
Nov 30 09:18:12 user nova-compute[75340]:     <apic/>
Nov 30 09:18:12 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:18:12 user nova-compute[75340]:   </features>
Nov 30 09:18:12 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:18:12 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:18:12 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:18:12 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:18:12 user nova-compute[75340]:   </clock>
Nov 30 09:18:12 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:18:12 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:18:12 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:18:12 user nova-compute[75340]:   </cpu>
Nov 30 09:18:12 user nova-compute[75340]:   <devices>
Nov 30 09:18:12 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:18:12 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:18:12 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk"/>
Nov 30 09:18:12 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:18:12 user nova-compute[75340]:     </disk>
Nov 30 09:18:12 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:18:12 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:18:12 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:18:12 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:18:12 user nova-compute[75340]:       <serial>efd4dbce-d836-491d-9109-cf96338dbcaf</serial>
Nov 30 09:18:12 user nova-compute[75340]:     </disk>
Nov 30 09:18:12 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:18:12 user nova-compute[75340]:       <mac address="fa:16:3e:f5:c0:76"/>
Nov 30 09:18:12 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:12 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:18:12 user nova-compute[75340]:       <target dev="tap4948b73b-dc"/>
Nov 30 09:18:12 user nova-compute[75340]:     </interface>
Nov 30 09:18:12 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:18:12 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/console.log" append="off"/>
Nov 30 09:18:12 user nova-compute[75340]:     </serial>
Nov 30 09:18:12 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:18:12 user nova-compute[75340]:     <video>
Nov 30 09:18:12 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:12 user nova-compute[75340]:     </video>
Nov 30 09:18:12 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:18:12 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:18:12 user nova-compute[75340]:     </rng>
Nov 30 09:18:12 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:18:12 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:18:12 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:18:12 user nova-compute[75340]:     </memballoon>
Nov 30 09:18:12 user nova-compute[75340]:   </devices>
Nov 30 09:18:12 user nova-compute[75340]: </domain>
Nov 30 09:18:12 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-849881350-network", "vif_mac": "fa:16:3e:f5:c0:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG os_vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '494210f0-3a33-59bb-8377-c4cfecdc7f41', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4948b73b-dc, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4948b73b-dc, col_values=(('qos', UUID('40bf5e14-d665-42f0-8d6e-8a4cc3fb7aac')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4948b73b-dc, col_values=(('external_ids', {'iface-id': '4948b73b-dc7f-4720-8006-1232706b4aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:76', 'vm-uuid': 'cd3f40a8-6a0f-4116-b654-e222153dd2a4'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:12 user nova-compute[75340]: INFO os_vif [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] No VIF found with MAC fa:16:3e:f5:c0:76, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:18:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:13 user nova-compute[75340]: WARNING nova.compute.manager [req-cb6f3f4d-638e-4fef-a1cd-af51241b6690 req-74d135e8-3571-44a6-bd8e-34dbbebebe9b service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state resize_finish.
Nov 30 09:18:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:18:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance running successfully.
Nov 30 09:18:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Failed to set time: agent not configured {{(pid=75340) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e287e486-291e-4d45-bff8-5421e379d2b6 tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] finish_migration finished successfully. {{(pid=75340) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:15 user nova-compute[75340]: WARNING nova.compute.manager [req-07640eda-2874-486b-974e-3abb93c13fe5 req-7a3f7ebb-4a7d-458e-96ef-f09e3a64c252 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state resize_finish.
Nov 30 09:18:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:18:27 user nova-compute[75340]: INFO nova.compute.claims [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Claim successful on node user
Nov 30 09:18:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:18:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.policy [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '221aef7b87f64a96a9fa77bcec0834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba97ab8c36f4de8ba045c19af810242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:18:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Creating image(s)
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:18:28 user nova-compute[75340]: INFO nova.compute.claims [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Claim successful on node user
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk 1073741824" returned: 0 in 0.072s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Cannot resize image /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Ensure instance console log exists: /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:18:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Successfully created port: 127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.policy [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '221aef7b87f64a96a9fa77bcec0834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba97ab8c36f4de8ba045c19af810242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:18:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Creating image(s)
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Cannot resize image /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Ensure instance console log exists: /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Successfully created port: a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Successfully updated port: 127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-changed-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Refreshing instance network info cache due to event network-changed-127608c1-d377-41d8-878e-8e3cec2f14d6. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance network_info: |[{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Refreshing network info cache for port 127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start _get_guest_xml network_info=[{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:18:31 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:31 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1711078597',display_name='tempest-ServerRescueNegativeTestJSON-server-1711078597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1711078597',id=19,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-4k020rwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:28Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=59ea1092-6591-4aae-aabd-325ed17ac394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Successfully updated port: a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:18:31 user nova-compute[75340]:   <uuid>59ea1092-6591-4aae-aabd-325ed17ac394</uuid>
Nov 30 09:18:31 user nova-compute[75340]:   <name>instance-00000013</name>
Nov 30 09:18:31 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:18:31 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:18:31 user nova-compute[75340]:   <metadata>
Nov 30 09:18:31 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:18:31 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1711078597</nova:name>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:18:31</nova:creationTime>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:18:31 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:18:31 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:owner>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:18:31 user nova-compute[75340]:       </nova:owner>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:18:31 user nova-compute[75340]:       <nova:ports>
Nov 30 09:18:31 user nova-compute[75340]:         <nova:port uuid="127608c1-d377-41d8-878e-8e3cec2f14d6">
Nov 30 09:18:31 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:18:31 user nova-compute[75340]:         </nova:port>
Nov 30 09:18:31 user nova-compute[75340]:       </nova:ports>
Nov 30 09:18:31 user nova-compute[75340]:     </nova:instance>
Nov 30 09:18:31 user nova-compute[75340]:   </metadata>
Nov 30 09:18:31 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:18:31 user nova-compute[75340]:     <system>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="serial">59ea1092-6591-4aae-aabd-325ed17ac394</entry>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="uuid">59ea1092-6591-4aae-aabd-325ed17ac394</entry>
Nov 30 09:18:31 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:18:31 user nova-compute[75340]:     </system>
Nov 30 09:18:31 user nova-compute[75340]:   </sysinfo>
Nov 30 09:18:31 user nova-compute[75340]:   <os>
Nov 30 09:18:31 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:18:31 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:18:31 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:18:31 user nova-compute[75340]:   </os>
Nov 30 09:18:31 user nova-compute[75340]:   <features>
Nov 30 09:18:31 user nova-compute[75340]:     <acpi/>
Nov 30 09:18:31 user nova-compute[75340]:     <apic/>
Nov 30 09:18:31 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:18:31 user nova-compute[75340]:   </features>
Nov 30 09:18:31 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:18:31 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:18:31 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:18:31 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:18:31 user nova-compute[75340]:   </clock>
Nov 30 09:18:31 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:18:31 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:18:31 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:18:31 user nova-compute[75340]:   </cpu>
Nov 30 09:18:31 user nova-compute[75340]:   <devices>
Nov 30 09:18:31 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:18:31 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:18:31 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk"/>
Nov 30 09:18:31 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:18:31 user nova-compute[75340]:     </disk>
Nov 30 09:18:31 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:18:31 user nova-compute[75340]:       <mac address="fa:16:3e:5a:01:00"/>
Nov 30 09:18:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:31 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:18:31 user nova-compute[75340]:       <target dev="tap127608c1-d3"/>
Nov 30 09:18:31 user nova-compute[75340]:     </interface>
Nov 30 09:18:31 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:18:31 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/console.log" append="off"/>
Nov 30 09:18:31 user nova-compute[75340]:     </serial>
Nov 30 09:18:31 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:18:31 user nova-compute[75340]:     <video>
Nov 30 09:18:31 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:31 user nova-compute[75340]:     </video>
Nov 30 09:18:31 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:18:31 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:18:31 user nova-compute[75340]:     </rng>
Nov 30 09:18:31 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:18:31 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:18:31 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:18:31 user nova-compute[75340]:     </memballoon>
Nov 30 09:18:31 user nova-compute[75340]:   </devices>
Nov 30 09:18:31 user nova-compute[75340]: </domain>
Nov 30 09:18:31 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1711078597',display_name='tempest-ServerRescueNegativeTestJSON-server-1711078597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1711078597',id=19,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-4k020rwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:28Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=59ea1092-6591-4aae-aabd-325ed17ac394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG os_vif [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3c7fbe8-8816-5ef8-b289-f6b9a4c8367b', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-changed-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Refreshing instance network info cache due to event network-changed-a6f97582-065e-4df0-a583-0973a0103911. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] Acquiring lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127608c1-d3, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap127608c1-d3, col_values=(('qos', UUID('3877d2eb-d372-4b4e-8d11-067821b0fcc8')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap127608c1-d3, col_values=(('external_ids', {'iface-id': '127608c1-d377-41d8-878e-8e3cec2f14d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:01:00', 'vm-uuid': '59ea1092-6591-4aae-aabd-325ed17ac394'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:31 user nova-compute[75340]: INFO os_vif [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3')
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:5a:01:00, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance network_info: |[{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] Acquired lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Refreshing network info cache for port a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start _get_guest_xml network_info=[{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:18:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:32 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-64774986',display_name='tempest-ServerRescueNegativeTestJSON-server-64774986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-64774986',id=20,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-yh0scy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:30Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=029a6160-a6bb-4a6a-ae54-22819e4c4bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updated VIF entry in instance network info cache for port 127608c1-d377-41d8-878e-8e3cec2f14d6. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:18:32 user nova-compute[75340]:   <uuid>029a6160-a6bb-4a6a-ae54-22819e4c4bd9</uuid>
Nov 30 09:18:32 user nova-compute[75340]:   <name>instance-00000014</name>
Nov 30 09:18:32 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:18:32 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:18:32 user nova-compute[75340]:   <metadata>
Nov 30 09:18:32 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:18:32 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-64774986</nova:name>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:18:32</nova:creationTime>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:18:32 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:18:32 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:owner>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:18:32 user nova-compute[75340]:       </nova:owner>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:18:32 user nova-compute[75340]:       <nova:ports>
Nov 30 09:18:32 user nova-compute[75340]:         <nova:port uuid="a6f97582-065e-4df0-a583-0973a0103911">
Nov 30 09:18:32 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:18:32 user nova-compute[75340]:         </nova:port>
Nov 30 09:18:32 user nova-compute[75340]:       </nova:ports>
Nov 30 09:18:32 user nova-compute[75340]:     </nova:instance>
Nov 30 09:18:32 user nova-compute[75340]:   </metadata>
Nov 30 09:18:32 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:18:32 user nova-compute[75340]:     <system>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="serial">029a6160-a6bb-4a6a-ae54-22819e4c4bd9</entry>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="uuid">029a6160-a6bb-4a6a-ae54-22819e4c4bd9</entry>
Nov 30 09:18:32 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:18:32 user nova-compute[75340]:     </system>
Nov 30 09:18:32 user nova-compute[75340]:   </sysinfo>
Nov 30 09:18:32 user nova-compute[75340]:   <os>
Nov 30 09:18:32 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:18:32 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:18:32 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:18:32 user nova-compute[75340]:   </os>
Nov 30 09:18:32 user nova-compute[75340]:   <features>
Nov 30 09:18:32 user nova-compute[75340]:     <acpi/>
Nov 30 09:18:32 user nova-compute[75340]:     <apic/>
Nov 30 09:18:32 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:18:32 user nova-compute[75340]:   </features>
Nov 30 09:18:32 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:18:32 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:18:32 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:18:32 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:18:32 user nova-compute[75340]:   </clock>
Nov 30 09:18:32 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:18:32 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:18:32 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:18:32 user nova-compute[75340]:   </cpu>
Nov 30 09:18:32 user nova-compute[75340]:   <devices>
Nov 30 09:18:32 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:18:32 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:18:32 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk"/>
Nov 30 09:18:32 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:18:32 user nova-compute[75340]:     </disk>
Nov 30 09:18:32 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:18:32 user nova-compute[75340]:       <mac address="fa:16:3e:d7:31:79"/>
Nov 30 09:18:32 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:32 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:18:32 user nova-compute[75340]:       <target dev="tapa6f97582-06"/>
Nov 30 09:18:32 user nova-compute[75340]:     </interface>
Nov 30 09:18:32 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:18:32 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/console.log" append="off"/>
Nov 30 09:18:32 user nova-compute[75340]:     </serial>
Nov 30 09:18:32 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:18:32 user nova-compute[75340]:     <video>
Nov 30 09:18:32 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:32 user nova-compute[75340]:     </video>
Nov 30 09:18:32 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:18:32 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:18:32 user nova-compute[75340]:     </rng>
Nov 30 09:18:32 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:18:32 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:18:32 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:18:32 user nova-compute[75340]:     </memballoon>
Nov 30 09:18:32 user nova-compute[75340]:   </devices>
Nov 30 09:18:32 user nova-compute[75340]: </domain>
Nov 30 09:18:32 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-64774986',display_name='tempest-ServerRescueNegativeTestJSON-server-64774986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-64774986',id=20,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-yh0scy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:30Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=029a6160-a6bb-4a6a-ae54-22819e4c4bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG os_vif [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3af2fcd-4cdf-5024-8160-ae0fcff6ff86', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e463b295-6614-4900-8e13-077ad5eb9884 req-ae53a6b0-c2f7-479a-be69-3aa407046049 service nova] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6f97582-06, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6f97582-06, col_values=(('qos', UUID('0d55d690-f397-4ec6-b033-88edb56251e7')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6f97582-06, col_values=(('external_ids', {'iface-id': 'a6f97582-065e-4df0-a583-0973a0103911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:31:79', 'vm-uuid': '029a6160-a6bb-4a6a-ae54-22819e4c4bd9'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:32 user nova-compute[75340]: INFO os_vif [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06')
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:d7:31:79, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updated VIF entry in instance network info cache for port a6f97582-065e-4df0-a583-0973a0103911. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e502b2c2-e6aa-4e6b-82a7-26177db53118 req-f23c74d1-637b-466b-b5e5-af07b0b75a93 service nova] Releasing lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:34 user nova-compute[75340]: WARNING nova.compute.manager [req-b6806a1a-2fb2-4cc2-8297-2c0b86ac1b5e req-17f17123-c5c1-4a14-be24-d25118afd195 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state building and task_state spawning.
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:36 user nova-compute[75340]: WARNING nova.compute.manager [req-4c2aa986-b21d-4e24-b921-209a60c2d9ed req-094b2ecc-bc89-45a9-a095-944e3c00e0e2 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state building and task_state spawning.
Nov 30 09:18:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:36 user nova-compute[75340]: WARNING nova.compute.manager [req-e62e066a-b8b4-434a-8e3a-63f00c147755 req-80ef36ec-10d4-45f5-873f-cb9d21f0bcd6 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state building and task_state spawning.
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:18:36 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance spawned successfully.
Nov 30 09:18:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance spawned successfully.
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:37 user nova-compute[75340]: INFO nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Took 7.53 seconds to spawn the instance on the hypervisor.
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:18:37 user nova-compute[75340]: INFO nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 30 09:18:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:18:37 user nova-compute[75340]: INFO nova.compute.manager [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Took 8.79 seconds to build instance.
Nov 30 09:18:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b58bd56b-2cbf-44af-854d-6c395b07221d tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.940s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:37 user nova-compute[75340]: INFO nova.compute.manager [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Took 9.77 seconds to build instance.
Nov 30 09:18:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-66fbb385-8496-4060-9686-8556d3886125 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.867s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:38 user nova-compute[75340]: INFO nova.compute.manager [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Rescuing
Nov 30 09:18:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:38 user nova-compute[75340]: WARNING nova.compute.manager [req-607a0858-f4cf-4b0c-a9d3-19193ebb49bc req-bfc3dfdf-0520-4515-b547-9559f8410da7 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state active and task_state None.
Nov 30 09:18:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance destroyed successfully.
Nov 30 09:18:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Attempting a stable device rescue
Nov 30 09:18:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:18:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Creating image(s)
Nov 30 09:18:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:42 user nova-compute[75340]: INFO nova.compute.manager [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Detaching volume 4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG nova.virt.images [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] 263db582-7507-4b7d-9668-f9e357ce37d3 was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.part /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:18:42 user nova-compute[75340]: INFO nova.virt.block_device [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Attempting to driver detach volume 4a0f56ba-7f79-4f48-97b0-80c0876a0087 from mountpoint /dev/vdb
Nov 30 09:18:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Attempting to detach device vdb from instance 30737691-a43b-44ec-93c2-b66868d553ac from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:18:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:18:42 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:18:42 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:18:42 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:18:42 user nova-compute[75340]:   <serial>4a0f56ba-7f79-4f48-97b0-80c0876a0087</serial>
Nov 30 09:18:42 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:18:42 user nova-compute[75340]: </disk>
Nov 30 09:18:42 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:18:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 30737691-a43b-44ec-93c2-b66868d553ac from the persistent domain config.
Nov 30 09:18:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30737691-a43b-44ec-93c2-b66868d553ac from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:18:43 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:18:43 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:18:43 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:18:43 user nova-compute[75340]:   <serial>4a0f56ba-7f79-4f48-97b0-80c0876a0087</serial>
Nov 30 09:18:43 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:18:43 user nova-compute[75340]: </disk>
Nov 30 09:18:43 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.part /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.converted" returned: 0 in 0.594s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.877s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41 --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41,backing_fmt=raw /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41,backing_fmt=raw /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue" returned: 0 in 0.067s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "096d322eac7c157fcb742cf6b2a10e154cb70d41" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'migration_context' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<3f707e1f-21fa-4122-94ee-7eb3f28df193> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start _get_guest_xml network_info=[{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:ae:90:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '263db582-7507-4b7d-9668-f9e357ce37d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c4ed4685-1371-4a6b-9568-4fb24c23d6ce', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3f707e1f-21fa-4122-94ee-7eb3f28df193', 'attached_at': '', 'detached_at': '', 'volume_id': 'a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'serial': 'a40d2f72-8aa2-47d8-b17f-0a570cca371f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<3f707e1f-21fa-4122-94ee-7eb3f28df193> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<3f707e1f-21fa-4122-94ee-7eb3f28df193> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:18:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<3f707e1f-21fa-4122-94ee-7eb3f28df193> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:18:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:18:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:18:44 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7bb161-2cae-4e1a-a901-33f1ba809daa]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ShcrkPlH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 09:18:44 user nova-compute[75340]: node.name = iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:18:44 user nova-compute[75340]: node.tpgt = -1
Nov 30 09:18:44 user nova-compute[75340]: node.startup = automatic
Nov 30 09:18:44 user nova-compute[75340]: node.leading_login = No
Nov 30 09:18:44 user nova-compute[75340]: iface.iscsi_ifacename = default
Nov 30 09:18:44 user nova-compute[75340]: iface.net_ifacename = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.ipaddress = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.prefix_len = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.hwaddress = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.transport_name = tcp
Nov 30 09:18:44 user nova-compute[75340]: iface.initiatorname = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.vlan_id = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.vlan_priority = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.vlan_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.iface_num = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.mtu = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.port = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.bootproto = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.subnet_mask = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.gateway = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_alt_client_id = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_dns = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_learn_iqn = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_vendor_id_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_vendor_id = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.dhcp_slp_da = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.fragmentation = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.gratuitous_arp = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.incoming_forwarding = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.tos_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.tos = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.ttl = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.delayed_ack = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.tcp_nagle = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.tcp_wsf_state = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.tcp_wsf = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.tcp_timer_scale = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.tcp_timestamp = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.redirect = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.def_task_mgmt_timeout = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.header_digest = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.data_digest = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.immediate_data = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.initial_r2t = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.data_seq_inorder = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.data_pdu_inorder = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.erl = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.max_receive_data_len = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.first_burst_len = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.max_outstanding_r2t = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.max_burst_len = 0
Nov 30 09:18:44 user nova-compute[75340]: iface.chap_auth = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.bidi_chap = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.strict_login_compliance = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.discovery_auth = <empty>
Nov 30 09:18:44 user nova-compute[75340]: iface.discovery_logout = <empty>
Nov 30 09:18:44 user nova-compute[75340]: node.discovery_address = <empty>
Nov 30 09:18:44 user nova-compute[75340]: node.discovery_port = 0
Nov 30 09:18:44 user nova-compute[75340]: node.discovery_type = static
Nov 30 09:18:44 user nova-compute[75340]: node.session.initial_cmdsn = 0
Nov 30 09:18:44 user nova-compute[75340]: node.session.initial_login_retry_max = 8
Nov 30 09:18:44 user nova-compute[75340]: node.session.xmit_thread_priority = -20
Nov 30 09:18:44 user nova-compute[75340]: node.session.cmds_max = 128
Nov 30 09:18:44 user nova-compute[75340]: node.session.queue_depth = 32
Nov 30 09:18:44 user nova-compute[75340]: node.session.nr_sessions = 1
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.authmethod = CHAP
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.username = ShcrkPlH
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.password = ***
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.username_in = <empty>
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.password_in = <empty>
Nov 30 09:18:44 user nova-compute[75340]: node.session.auth.chap_algs = MD5
Nov 30 09:18:44 user nova-compute[75340]: node.session.timeo.replacement_timeout = 120
Nov 30 09:18:44 user nova-compute[75340]: node.session.err_timeo.abort_timeout = 15
Nov 30 09:18:44 user nova-compute[75340]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 09:18:44 user nova-compute[75340]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 09:18:44 user nova-compute[75340]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.FastAbort = Yes
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.InitialR2T = No
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.ImmediateData = Yes
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.MaxConnections = 1
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 09:18:44 user nova-compute[75340]: node.session.iscsi.ERL = 0
Nov 30 09:18:44 user nova-compute[75340]: node.session.scan = manual
Nov 30 09:18:44 user nova-compute[75340]: node.session.reopen_max = 0
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].address = 172.16.0.220
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].port = 3260
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].startup = manual
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].tcp.window_size = 524288
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].tcp.type_of_service = 0
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].timeo.logout_timeout = 15
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].timeo.login_timeout = 15
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].timeo.auth_timeout = 45
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.DataDigest = None
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.IFMarker = No
Nov 30 09:18:44 user nova-compute[75340]: node.conn[0].iscsi.OFMarker = No
Nov 30 09:18:44 user nova-compute[75340]: # END RECORD
Nov 30 09:18:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccbc8c1-8f90-4d37-ae1e-ec24c3f83a5f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[722df164-ba06-4ffd-9a2f-783c2c6fbdec]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShcrkPlH {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShcrkPlH" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9759d-ac00-45c6-80b1-67c88ebb808c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShcrkPlH'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d538c25-94be-4938-a5e4-d860c423ac40]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7fe247-5029-4dcd-b12f-a08170d63fe1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:44 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:18:44 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:18:44 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:18:44 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:18:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.212s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa277cf3-ea3e-4cac-8abc-3483ecc137e2]: (4, ('0 0 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.252s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== connect_volume: return (255ms) {'type': 'block', 'scsi_wwn': '26665343465363539', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665343465363539', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1987351367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1987351367',id=15,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-k2ynkn0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:17:10Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=3f707e1f-21fa-4122-94ee-7eb3f28df193,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:ae:90:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:ae:90:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.objects.base [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<3f707e1f-21fa-4122-94ee-7eb3f28df193> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:18:44 user nova-compute[75340]:   <uuid>3f707e1f-21fa-4122-94ee-7eb3f28df193</uuid>
Nov 30 09:18:44 user nova-compute[75340]:   <name>instance-0000000f</name>
Nov 30 09:18:44 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:18:44 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:18:44 user nova-compute[75340]:   <metadata>
Nov 30 09:18:44 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:18:44 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1987351367</nova:name>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:18:44</nova:creationTime>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:18:44 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:18:44 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:owner>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:18:44 user nova-compute[75340]:       </nova:owner>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:18:44 user nova-compute[75340]:       <nova:ports>
Nov 30 09:18:44 user nova-compute[75340]:         <nova:port uuid="566ae665-b699-43cb-8d13-55fd4866990a">
Nov 30 09:18:44 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:18:44 user nova-compute[75340]:         </nova:port>
Nov 30 09:18:44 user nova-compute[75340]:       </nova:ports>
Nov 30 09:18:44 user nova-compute[75340]:     </nova:instance>
Nov 30 09:18:44 user nova-compute[75340]:   </metadata>
Nov 30 09:18:44 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:18:44 user nova-compute[75340]:     <system>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="serial">3f707e1f-21fa-4122-94ee-7eb3f28df193</entry>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="uuid">3f707e1f-21fa-4122-94ee-7eb3f28df193</entry>
Nov 30 09:18:44 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:18:44 user nova-compute[75340]:     </system>
Nov 30 09:18:44 user nova-compute[75340]:   </sysinfo>
Nov 30 09:18:44 user nova-compute[75340]:   <os>
Nov 30 09:18:44 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:18:44 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:18:44 user nova-compute[75340]:   </os>
Nov 30 09:18:44 user nova-compute[75340]:   <features>
Nov 30 09:18:44 user nova-compute[75340]:     <acpi/>
Nov 30 09:18:44 user nova-compute[75340]:     <apic/>
Nov 30 09:18:44 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:18:44 user nova-compute[75340]:   </features>
Nov 30 09:18:44 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:18:44 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:18:44 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:18:44 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:18:44 user nova-compute[75340]:   </clock>
Nov 30 09:18:44 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:18:44 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:18:44 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:18:44 user nova-compute[75340]:   </cpu>
Nov 30 09:18:44 user nova-compute[75340]:   <devices>
Nov 30 09:18:44 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:18:44 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:18:44 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:18:44 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:18:44 user nova-compute[75340]:       <serial>a40d2f72-8aa2-47d8-b17f-0a570cca371f</serial>
Nov 30 09:18:44 user nova-compute[75340]:     </disk>
Nov 30 09:18:44 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:18:44 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:18:44 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue"/>
Nov 30 09:18:44 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:18:44 user nova-compute[75340]:       <boot order="1"/>
Nov 30 09:18:44 user nova-compute[75340]:     </disk>
Nov 30 09:18:44 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:18:44 user nova-compute[75340]:       <mac address="fa:16:3e:ae:90:b9"/>
Nov 30 09:18:44 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:44 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:18:44 user nova-compute[75340]:       <target dev="tap566ae665-b6"/>
Nov 30 09:18:44 user nova-compute[75340]:     </interface>
Nov 30 09:18:44 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:18:44 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/console.log" append="off"/>
Nov 30 09:18:44 user nova-compute[75340]:     </serial>
Nov 30 09:18:44 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:18:44 user nova-compute[75340]:     <video>
Nov 30 09:18:44 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:44 user nova-compute[75340]:     </video>
Nov 30 09:18:44 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:18:44 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:18:44 user nova-compute[75340]:     </rng>
Nov 30 09:18:44 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:18:44 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:18:44 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:18:44 user nova-compute[75340]:     </memballoon>
Nov 30 09:18:44 user nova-compute[75340]:   </devices>
Nov 30 09:18:44 user nova-compute[75340]: </domain>
Nov 30 09:18:44 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:18:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance destroyed successfully.
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:ae:90:b9, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:18:44 user nova-compute[75340]: INFO nova.compute.claims [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Claim successful on node user
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.014s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:18:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:46 user nova-compute[75340]: WARNING nova.compute.manager [req-a5668388-d6ce-4c0c-b716-7e03b147e69b req-03a1df5e-5cfe-4c28-b5da-98211e13117c service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state active and task_state rescuing.
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.policy [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28e1f2386a5048c48131d6d1ef0550bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c13e39440043da8ad17279e7f77ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:18:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Creating image(s)
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "/opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "/opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.324s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.233s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk 1073741824" returned: 0 in 0.063s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Successfully created port: 21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.271s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Cannot resize image /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Ensure instance console log exists: /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:18:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:48 user nova-compute[75340]: WARNING nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state active and task_state rescuing.
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:48 user nova-compute[75340]: WARNING nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state active and task_state rescuing.
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:48 user nova-compute[75340]: WARNING nova.compute.manager [req-8ffb5d82-7969-4e7c-b3bf-690998596b56 req-47d0a883-1c8b-449b-bb4f-dbad9581c10f service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state active and task_state rescuing.
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Successfully updated port: 21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquired lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-changed-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Refreshing instance network info cache due to event network-changed-21391617-2354-4e59-a3e6-ac4e041ce0b3. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] Acquiring lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-899c4329-fa45-4ef2-b24c-6acf703cfad1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Updating instance_info_cache with network_info: [{"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Releasing lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Instance network_info: |[{"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] Acquired lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Refreshing network info cache for port 21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Start _get_guest_xml network_info=[{"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1524401047',display_name='tempest-VolumesActionsTest-instance-1524401047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1524401047',id=21,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c13e39440043da8ad17279e7f77ba5',ramdisk_id='',reservation_id='r-z6png81w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1601763647',owner_user_name='tempest-VolumesActionsTest-1601763647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:46Z,user_data=None,user_id='28e1f2386a5048c48131d6d1ef0550bf',uuid=c6ff93f6-b93f-4898-a587-9c74b3002b8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converting VIF {"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lazy-loading 'pci_devices' on Instance uuid c6ff93f6-b93f-4898-a587-9c74b3002b8f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:18:49 user nova-compute[75340]:   <uuid>c6ff93f6-b93f-4898-a587-9c74b3002b8f</uuid>
Nov 30 09:18:49 user nova-compute[75340]:   <name>instance-00000015</name>
Nov 30 09:18:49 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:18:49 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:18:49 user nova-compute[75340]:   <metadata>
Nov 30 09:18:49 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:18:49 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:name>tempest-VolumesActionsTest-instance-1524401047</nova:name>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:18:49</nova:creationTime>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:18:49 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:18:49 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:owner>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:user uuid="28e1f2386a5048c48131d6d1ef0550bf">tempest-VolumesActionsTest-1601763647-project-member</nova:user>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:project uuid="30c13e39440043da8ad17279e7f77ba5">tempest-VolumesActionsTest-1601763647</nova:project>
Nov 30 09:18:49 user nova-compute[75340]:       </nova:owner>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:18:49 user nova-compute[75340]:       <nova:ports>
Nov 30 09:18:49 user nova-compute[75340]:         <nova:port uuid="21391617-2354-4e59-a3e6-ac4e041ce0b3">
Nov 30 09:18:49 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 09:18:49 user nova-compute[75340]:         </nova:port>
Nov 30 09:18:49 user nova-compute[75340]:       </nova:ports>
Nov 30 09:18:49 user nova-compute[75340]:     </nova:instance>
Nov 30 09:18:49 user nova-compute[75340]:   </metadata>
Nov 30 09:18:49 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:18:49 user nova-compute[75340]:     <system>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="serial">c6ff93f6-b93f-4898-a587-9c74b3002b8f</entry>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="uuid">c6ff93f6-b93f-4898-a587-9c74b3002b8f</entry>
Nov 30 09:18:49 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:18:49 user nova-compute[75340]:     </system>
Nov 30 09:18:49 user nova-compute[75340]:   </sysinfo>
Nov 30 09:18:49 user nova-compute[75340]:   <os>
Nov 30 09:18:49 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:18:49 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:18:49 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:18:49 user nova-compute[75340]:   </os>
Nov 30 09:18:49 user nova-compute[75340]:   <features>
Nov 30 09:18:49 user nova-compute[75340]:     <acpi/>
Nov 30 09:18:49 user nova-compute[75340]:     <apic/>
Nov 30 09:18:49 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:18:49 user nova-compute[75340]:   </features>
Nov 30 09:18:49 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:18:49 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:18:49 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:18:49 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:18:49 user nova-compute[75340]:   </clock>
Nov 30 09:18:49 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:18:49 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:18:49 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:18:49 user nova-compute[75340]:   </cpu>
Nov 30 09:18:49 user nova-compute[75340]:   <devices>
Nov 30 09:18:49 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:18:49 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:18:49 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk"/>
Nov 30 09:18:49 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:18:49 user nova-compute[75340]:     </disk>
Nov 30 09:18:49 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:18:49 user nova-compute[75340]:       <mac address="fa:16:3e:cf:f2:75"/>
Nov 30 09:18:49 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:49 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:18:49 user nova-compute[75340]:       <target dev="tap21391617-23"/>
Nov 30 09:18:49 user nova-compute[75340]:     </interface>
Nov 30 09:18:49 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:18:49 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/console.log" append="off"/>
Nov 30 09:18:49 user nova-compute[75340]:     </serial>
Nov 30 09:18:49 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:18:49 user nova-compute[75340]:     <video>
Nov 30 09:18:49 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:18:49 user nova-compute[75340]:     </video>
Nov 30 09:18:49 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:18:49 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:18:49 user nova-compute[75340]:     </rng>
Nov 30 09:18:49 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:18:49 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:18:49 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:18:49 user nova-compute[75340]:     </memballoon>
Nov 30 09:18:49 user nova-compute[75340]:   </devices>
Nov 30 09:18:49 user nova-compute[75340]: </domain>
Nov 30 09:18:49 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1524401047',display_name='tempest-VolumesActionsTest-instance-1524401047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1524401047',id=21,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30c13e39440043da8ad17279e7f77ba5',ramdisk_id='',reservation_id='r-z6png81w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1601763647',owner_user_name='tempest-VolumesActionsTest-1601763647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:46Z,user_data=None,user_id='28e1f2386a5048c48131d6d1ef0550bf',uuid=c6ff93f6-b93f-4898-a587-9c74b3002b8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converting VIF {"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG os_vif [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f69badcc-4a70-5461-959d-10c5af0d66bb', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21391617-23, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21391617-23, col_values=(('qos', UUID('bb97f867-4bf9-4c21-995c-5756290cc46d')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21391617-23, col_values=(('external_ids', {'iface-id': '21391617-2354-4e59-a3e6-ac4e041ce0b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:f2:75', 'vm-uuid': 'c6ff93f6-b93f-4898-a587-9c74b3002b8f'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:49 user nova-compute[75340]: INFO os_vif [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23')
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] No VIF found with MAC fa:16:3e:cf:f2:75, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Updated VIF entry in instance network info cache for port 21391617-2354-4e59-a3e6-ac4e041ce0b3. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Updating instance_info_cache with network_info: [{"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6ddf62e8-baa1-465d-948e-6953bda7c1dc req-c4005983-211c-4a09-bdf1-b0be52f3c0e1 service nova] Releasing lock "refresh_cache-c6ff93f6-b93f-4898-a587-9c74b3002b8f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:18:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:18:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:18:54 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Instance spawned successfully.
Nov 30 09:18:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7395MB free_disk=25.39596939086914GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.manager [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] No waiting events found dispatching network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:54 user nova-compute[75340]: WARNING nova.compute.manager [req-cf630bbc-e8e0-4e2b-bdc8-202a497101e7 req-286191e5-5351-4479-a6ef-55c3c4c505ad service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received unexpected event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 for instance with vm_state building and task_state spawning.
Nov 30 09:18:54 user nova-compute[75340]: INFO nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Took 8.44 seconds to spawn the instance on the hypervisor.
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Applying migration context for instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 as it has an incoming, in-progress migration 39f44288-573c-4c17-944f-cd58a1a2d944. Migration status is finished {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 09:18:54 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating resource usage from migration 39f44288-573c-4c17-944f-cd58a1a2d944
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 30737691-a43b-44ec-93c2-b66868d553ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 775afdeb-983c-44cf-be40-ad56aa1ab226 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Migration 39f44288-573c-4c17-944f-cd58a1a2d944 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c6ff93f6-b93f-4898-a587-9c74b3002b8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:18:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:18:54 user nova-compute[75340]: INFO nova.compute.manager [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Took 10.03 seconds to build instance.
Nov 30 09:18:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec0448af-1f5d-4aa7-a340-2ab8cb4920e5 tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.217s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:18:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:18:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:18:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.954s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:18:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:18:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:18:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:18:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] No waiting events found dispatching network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:18:56 user nova-compute[75340]: WARNING nova.compute.manager [req-9642f493-2fba-47d4-8984-ecdd3ca5ceed req-36e273db-ae43-4007-888a-3d6c389f6a5f service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received unexpected event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 for instance with vm_state active and task_state None.
Nov 30 09:18:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:18:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 30737691-a43b-44ec-93c2-b66868d553ac is timed out.
Nov 30 09:19:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 30737691-a43b-44ec-93c2-b66868d553ac from the live domain config.
Nov 30 09:19:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAfgtFXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5badb1a-bc9c-431c-b42b-08bf5ece9bb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:19:03 user nova-compute[75340]: No targets found.
Nov 30 09:19:03 user nova-compute[75340]: iSNS:
Nov 30 09:19:03 user nova-compute[75340]: No targets found.
Nov 30 09:19:03 user nova-compute[75340]: STATIC:
Nov 30 09:19:03 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:19:03 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:03 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:03 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:19:03 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:03 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:03 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087
Nov 30 09:19:03 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:03 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:03 user nova-compute[75340]: FIRMWARE:
Nov 30 09:19:03 user nova-compute[75340]: No targets found.
Nov 30 09:19:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:19:03 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:19:03 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa793790-0baa-40a0-be4f-d19dcd0d90db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4e2c2-13b8-4e94-aaf6-799ea3c7f787]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:03 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:03 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:19:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:03 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:03 user nova-compute[75340]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 (non-flash)
Nov 30 09:19:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff30606b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087'): ({'sde'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Removing single pathed devices sde {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e9b2c-8f68-43c8-b3ba-79bdd54a9c42]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de494f1-74c4-4ed6-9086-53c31b0aef42]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flushing IO for device /dev/sde {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fcf48-9957-4b7a-b14b-559daf631de5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5192345-4e81-4b35-abf4-f6e4c2316e61]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[57609c1f-0239-4328-8ca1-51f5066cd7db]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a6e05b-57e7-4829-9997-fa43dfbda859]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260]
Nov 30 09:19:04 user nova-compute[75340]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087, portal: 172.16.0.220,3260] successful.
Nov 30 09:19:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0f56ba-7f79-4f48-97b0-80c0876a0087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c078c86-ae27-40d7-85f0-1c58ee960393]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== disconnect_volume: return (410ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:19:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0c0971fa-ef8b-4133-969a-43624970927b tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.728s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:07 user nova-compute[75340]: INFO nova.compute.manager [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Terminating instance
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-unplugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] No waiting events found dispatching network-vif-unplugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-6cc20abc-8666-493a-a3af-e9187e94cc2f req-659697e8-414e-4fda-8965-780ca8801519 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-unplugged-316c6d06-b71e-4282-afa1-6476ae783519 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Instance destroyed successfully.
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'resources' on Instance uuid 775afdeb-983c-44cf-be40-ad56aa1ab226 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-311998467',display_name='tempest-VolumesAdminNegativeTest-server-311998467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-311998467',id=16,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-9z0i7p45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:17:16Z,user_data=None,user_id='a5b50ed776a541748fbfc920306c4f43',uuid=775afdeb-983c-44cf-be40-ad56aa1ab226,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "316c6d06-b71e-4282-afa1-6476ae783519", "address": "fa:16:3e:9c:b7:66", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316c6d06-b7", "ovs_interfaceid": "316c6d06-b71e-4282-afa1-6476ae783519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG os_vif [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap316c6d06-b7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02ce5777-707e-4feb-a5ac-4b52e18a4115) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:07 user nova-compute[75340]: INFO os_vif [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b7:66,bridge_name='br-int',has_traffic_filtering=True,id=316c6d06-b71e-4282-afa1-6476ae783519,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316c6d06-b7')
Nov 30 09:19:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Deleting instance files /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226_del
Nov 30 09:19:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Deletion of /opt/stack/data/nova/instances/775afdeb-983c-44cf-be40-ad56aa1ab226_del complete
Nov 30 09:19:08 user nova-compute[75340]: INFO nova.compute.manager [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 30 09:19:08 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:19:08 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:19:08 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:19:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:09 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Took 1.03 seconds to deallocate network for instance.
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-5c0fe1c4-4475-4803-9f43-21bd14bf24bd req-b1dd0da0-5ff6-4255-8ba6-39490c0f2251 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-deleted-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:09 user nova-compute[75340]: INFO nova.compute.manager [req-5c0fe1c4-4475-4803-9f43-21bd14bf24bd req-b1dd0da0-5ff6-4255-8ba6-39490c0f2251 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Neutron deleted interface 316c6d06-b71e-4282-afa1-6476ae783519; detaching it from the instance and deleting it from the info cache
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-5c0fe1c4-4475-4803-9f43-21bd14bf24bd req-b1dd0da0-5ff6-4255-8ba6-39490c0f2251 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-5c0fe1c4-4475-4803-9f43-21bd14bf24bd req-b1dd0da0-5ff6-4255-8ba6-39490c0f2251 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Detach interface failed, port_id=316c6d06-b71e-4282-afa1-6476ae783519, reason: Instance 775afdeb-983c-44cf-be40-ad56aa1ab226 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] Acquiring lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] No waiting events found dispatching network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:09 user nova-compute[75340]: WARNING nova.compute.manager [req-d3c7d75a-f15b-43ef-b89a-3ba6e7ec05fa req-1db58da1-ce90-4c9b-83be-c2680856cf90 service nova] [instance: 775afdeb-983c-44cf-be40-ad56aa1ab226] Received unexpected event network-vif-plugged-316c6d06-b71e-4282-afa1-6476ae783519 for instance with vm_state deleted and task_state None.
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:09 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Deleted allocations for instance 775afdeb-983c-44cf-be40-ad56aa1ab226
Nov 30 09:19:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-80ed152a-db4a-4e6e-ab4e-ec829066f153 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "775afdeb-983c-44cf-be40-ad56aa1ab226" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:11 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:19:11 user nova-compute[75340]: INFO nova.compute.claims [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Claim successful on node user
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:19:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:19:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:19:12 user nova-compute[75340]: INFO nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Booting with volume a7254610-c0e8-489a-9969-d0600d8c1acb at /dev/vda
Nov 30 09:19:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG nova.policy [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0df98d618a24eeaa3177dbfa0c34b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e48df89a5f4191baf8803d1fce4543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[694e3bc0-5b1d-4928-88ae-13f553b9bd23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac67f5-af33-4110-b7bb-bc3b5fe04699]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccdfeec-b601-4637-a73b-3cb455cc9394]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[997359dc-bca8-4c13-ab0d-0d5dbd316b64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:13 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50c26a-8965-497c-be89-14fe43ed893e]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating existing volume attachment record: 1bfcd053-6513-4bc5-8c22-d4e8611219e8 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:13 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully created port: f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully created port: c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully created port: ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully created port: db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully created port: 38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-f8013651-1781-4640-ab51-752ffb484494. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-90994cf1-91d7-4193-b3fa-30d5fb62f09b req-cb56790c-7491-45ca-a0b2-c8d72b829802 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: 852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-852297e3-9240-407e-b53b-d5e45cd80f87. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port 852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:19:20 user nova-compute[75340]: INFO nova.compute.claims [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Claim successful on node user
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fe52603c-6b5c-47d9-afaa-a8025ea84a11 req-88d83ee7-1d24-4a16-bfe6-f0869263cec8 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-ed449386-4cd7-4e58-aee3-c2318e4f55ca. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:19:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:19:21 user nova-compute[75340]: INFO nova.virt.block_device [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Booting with volume dd197763-bcf4-4069-95c4-a818fa2dfa73 at /dev/vda
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b47ac721-a633-41f3-8d08-c6558b7ba915 req-05337a6a-039e-4a91-9edb-281ac255ab59 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.utils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa2d02-89d5-4de3-a956-1eebbc27bbfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc9d95-7064-4f3a-9360-9c220a565083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a527c-8f87-435a-94be-adc4e72fa652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a8622-4b72-4173-a6fd-9db233d8dc83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:21 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c38d4d5-6131-420f-bdfb-fc9807f68449]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG os_brick.utils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:21 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating existing volume attachment record: b1d52d74-288d-4dda-82cb-ca4a23d4bbc1 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-c3d4f3e2-52a0-4af7-96ac-cc442a708403. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.network.neutron [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.policy [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a28287fd9aa4e5fb60248a68fc79836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dc7cb1fbef4211bc357a83142f9ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.network.neutron [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.network.neutron [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-be39ceb8-571d-4d4c-af0e-4d62a72ec27a req-0c386b18-7067-4f65-a6a4-9c1fb761d797 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Successfully created port: 7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-db87c456-e7c1-4344-91fe-c6f5d61cf22d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Successfully updated port: 38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Successfully updated port: 7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquired lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86633804-a10e-4ed5-9d5c-77f1c760a32e req-a3d4a26c-15fa-451a-ac3b-47e0c7fbfc2e service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating instance_info_cache with network_info: [{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Releasing lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance network_info: |[{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:19:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-38c38183-8c09-4e61-ba91-a2bbda235541. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-changed-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Refreshing instance network info cache due to event network-changed-4b66c617-632c-4a02-9820-6af836ca78ab. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] Acquiring lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] Acquired lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Refreshing network info cache for port 4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance network_info: |[{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port 38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updated VIF entry in instance network info cache for port 4b66c617-632c-4a02-9820-6af836ca78ab. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating instance_info_cache with network_info: [{"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4a58078c-dbfe-46e6-9db3-b7c76af31261 req-dcd1bd9b-f5db-4a8a-9390-a03fa4e28496 service nova] Releasing lock "refresh_cache-2c5351f7-c57f-4b35-8642-3a124259bef7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updated VIF entry in instance network info cache for port 38c38183-8c09-4e61-ba91-a2bbda235541. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-changed-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Refreshing instance network info cache due to event network-changed-7f89c78c-5bf5-4138-858a-01076110bea6. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Acquiring lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Acquired lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Refreshing network info cache for port 7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:27 user nova-compute[75340]: INFO nova.compute.manager [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attaching volume 415a56d6-6871-4721-bc9c-b7b66b290a2a to /dev/vdb
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.utils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[015c56f0-c7b1-4c53-b0b7-efc72c803efb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4d060-be4c-4b7f-9e5b-d98232da1b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[911797c0-f526-411e-973f-95688caccf41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0906758-8037-45a3-950f-f9e972f39c87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:27 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9002d8b2-bb56-44c2-93ea-b1b12df520eb]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG os_brick.utils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating existing volume attachment record: dd28f48a-beda-44ec-95e5-42b810dcde77 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updated VIF entry in instance network info cache for port 7f89c78c-5bf5-4138-858a-01076110bea6. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG nova.network.neutron [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating instance_info_cache with network_info: [{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3457e908-c208-4ba3-8a96-9b4ae80f213e req-26ff1d59-513c-43c8-9fd1-b8d834516804 service nova] Releasing lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-changed-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Refreshing instance network info cache due to event network-changed-738e3ea5-c7f7-4353-8a1f-a5c9115cb244. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] Acquiring lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] Acquired lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.network.neutron [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Refreshing network info cache for port 738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.network.neutron [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updated VIF entry in instance network info cache for port 738e3ea5-c7f7-4353-8a1f-a5c9115cb244. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG nova.network.neutron [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating instance_info_cache with network_info: [{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-901f120b-a7d3-4a72-8945-05ba0f36c859 req-a0201847-276e-4341-b007-b12ef478809e service nova] Releasing lock "refresh_cache-9455558a-7e24-449d-a515-436c818bf5c4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:33 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:19:34 user nova-compute[75340]: INFO nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Booting with volume 23bf61d5-c83d-46d3-b268-ba003594e97c at /dev/vdb
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:34 user nova-compute[75340]: INFO nova.compute.manager [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Terminating instance
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.objects.instance [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'flavor' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:19:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Creating image(s)
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Ensure instance console log exists: /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start _get_guest_xml network_info=[{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'b1d52d74-288d-4dda-82cb-ca4a23d4bbc1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '279b49b7-6b6f-4d14-bc3a-ae18849bf122', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd197763-bcf4-4069-95c4-a818fa2dfa73', 'serial': 'dd197763-bcf4-4069-95c4-a818fa2dfa73'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c16e4-3a96-4c87-9f9e-759d45b26235]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:19:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ddf82-e751-4203-b2ab-eaff26876741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:34 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:34 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:34 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea25c0-7cdb-4b82-8476-0af254203a1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643b878-ddb8-4d02-9662-093c1c35151e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[90de4bb8-44ab-4743-8f4a-cc61fdda1590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:19:34 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[903501dc-4d88-4e15-93ca-8479f72fed2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73] added
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:34 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b98db8-cc38-4a08-97c5-ff632a734f31]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating existing volume attachment record: 3a5832f4-0cac-4526-a4a9-418094f51c46 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc5943-0395-4987-89e5-8478c50030f8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d0375c-c9e5-4347-ab1a-63c684ec9491]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtcqsMKu {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtcqsMKu" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea85e3-a4fb-4ed1-976a-ed9ad59ac3f8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtcqsMKu'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb04de43-a0ed-48ad-800a-2062a6df9c24]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: INFO nova.compute.manager [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attaching volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2 to /dev/vdb
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1029b686-4001-4430-8b86-6f07150c4034]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.utils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-unplugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] No waiting events found dispatching network-vif-unplugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-5feb6baf-6070-4e88-9c25-759eb98dbc50 req-c359f6e8-7b2b-4b58-aa86-7d79b5dcc1e7 service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-unplugged-41652583-81c1-4a67-b474-8231b70b84aa for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f81c2f1-618c-40fe-a13c-74f937d76d51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9521e8a3-46f0-4d99-9bbe-7f336cf66155]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]
Nov 30 09:19:34 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d00ec6-1f0d-494b-bb2a-099f0a6980da]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d82071-3dcd-45f5-bf75-df9440ff7652]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b0a2db-855c-4f7d-8966-7841632739e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:34 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:34 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fb2c3-d9d4-4bcb-b597-6ab7f9cd9a87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e8ffc2-7e00-46ef-ab1e-96438e933673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:34 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc054453-20c1-4a03-830b-853422b3dc6a]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:35 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba1ac1-0497-4cad-bbe5-79c9310400c6]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_brick.utils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating existing volume attachment record: 8317020c-b36d-4cbe-abac-c6dc26ac8777 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Instance destroyed successfully.
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'resources' on Instance uuid 30737691-a43b-44ec-93c2-b66868d553ac {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1653516342',display_name='tempest-AttachVolumeNegativeTest-server-1653516342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1653516342',id=4,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdKaRKUVh87uXt1DoSswmxCdhjfMq9yrh3yqgIhN+yTvZD6eMjG8RMbw+/H+j7aUYqUeoSIcfmjvbm4fsd1A1dy9kai/cG/FsMGVRS1bzrmGPDeJeCdAdLJ9a9r/1gTmg==',key_name='tempest-keypair-212676230',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-e0ii0qig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=30737691-a43b-44ec-93c2-b66868d553ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "41652583-81c1-4a67-b474-8231b70b84aa", "address": "fa:16:3e:82:79:c4", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41652583-81", "ovs_interfaceid": "41652583-81c1-4a67-b474-8231b70b84aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG os_vif [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41652583-81, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b34a21d-b77a-4a8b-b46d-d59ca3e1dc19) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:35 user nova-compute[75340]: INFO os_vif [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=41652583-81c1-4a67-b474-8231b70b84aa,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41652583-81')
Nov 30 09:19:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Deleting instance files /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac_del
Nov 30 09:19:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Deletion of /opt/stack/data/nova/instances/30737691-a43b-44ec-93c2-b66868d553ac_del complete
Nov 30 09:19:35 user nova-compute[75340]: INFO nova.compute.manager [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:35 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26265333530383531', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265333530383531', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-416755434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lazy-loading 'pci_devices' on Instance uuid 279b49b7-6b6f-4d14-bc3a-ae18849bf122 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:19:36 user nova-compute[75340]:   <uuid>279b49b7-6b6f-4d14-bc3a-ae18849bf122</uuid>
Nov 30 09:19:36 user nova-compute[75340]:   <name>instance-00000017</name>
Nov 30 09:19:36 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:19:36 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:19:36 user nova-compute[75340]:   <metadata>
Nov 30 09:19:36 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:19:36 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:19:36 user nova-compute[75340]:       <nova:name>tempest-ServerActionsV293TestJSON-server-416755434</nova:name>
Nov 30 09:19:36 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:19:34</nova:creationTime>
Nov 30 09:19:36 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:19:36 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:19:36 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:19:36 user nova-compute[75340]:       <nova:owner>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:user uuid="5a28287fd9aa4e5fb60248a68fc79836">tempest-ServerActionsV293TestJSON-755520446-project-member</nova:user>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:project uuid="24dc7cb1fbef4211bc357a83142f9ae2">tempest-ServerActionsV293TestJSON-755520446</nova:project>
Nov 30 09:19:36 user nova-compute[75340]:       </nova:owner>
Nov 30 09:19:36 user nova-compute[75340]:       <nova:ports>
Nov 30 09:19:36 user nova-compute[75340]:         <nova:port uuid="7f89c78c-5bf5-4138-858a-01076110bea6">
Nov 30 09:19:36 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:19:36 user nova-compute[75340]:         </nova:port>
Nov 30 09:19:36 user nova-compute[75340]:       </nova:ports>
Nov 30 09:19:36 user nova-compute[75340]:     </nova:instance>
Nov 30 09:19:36 user nova-compute[75340]:   </metadata>
Nov 30 09:19:36 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:19:36 user nova-compute[75340]:     <system>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="serial">279b49b7-6b6f-4d14-bc3a-ae18849bf122</entry>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="uuid">279b49b7-6b6f-4d14-bc3a-ae18849bf122</entry>
Nov 30 09:19:36 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:19:36 user nova-compute[75340]:     </system>
Nov 30 09:19:36 user nova-compute[75340]:   </sysinfo>
Nov 30 09:19:36 user nova-compute[75340]:   <os>
Nov 30 09:19:36 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:19:36 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:19:36 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:19:36 user nova-compute[75340]:   </os>
Nov 30 09:19:36 user nova-compute[75340]:   <features>
Nov 30 09:19:36 user nova-compute[75340]:     <acpi/>
Nov 30 09:19:36 user nova-compute[75340]:     <apic/>
Nov 30 09:19:36 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:19:36 user nova-compute[75340]:   </features>
Nov 30 09:19:36 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:19:36 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:19:36 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:19:36 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:19:36 user nova-compute[75340]:   </clock>
Nov 30 09:19:36 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:19:36 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:19:36 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:19:36 user nova-compute[75340]:   </cpu>
Nov 30 09:19:36 user nova-compute[75340]:   <devices>
Nov 30 09:19:36 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:19:36 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:19:36 user nova-compute[75340]:       <source dev="/dev/sdd"/>
Nov 30 09:19:36 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:19:36 user nova-compute[75340]:       <serial>dd197763-bcf4-4069-95c4-a818fa2dfa73</serial>
Nov 30 09:19:36 user nova-compute[75340]:     </disk>
Nov 30 09:19:36 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:19:36 user nova-compute[75340]:       <mac address="fa:16:3e:e9:78:31"/>
Nov 30 09:19:36 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:19:36 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:19:36 user nova-compute[75340]:       <target dev="tap7f89c78c-5b"/>
Nov 30 09:19:36 user nova-compute[75340]:     </interface>
Nov 30 09:19:36 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:19:36 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122/console.log" append="off"/>
Nov 30 09:19:36 user nova-compute[75340]:     </serial>
Nov 30 09:19:36 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:19:36 user nova-compute[75340]:     <video>
Nov 30 09:19:36 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:19:36 user nova-compute[75340]:     </video>
Nov 30 09:19:36 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:19:36 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:19:36 user nova-compute[75340]:     </rng>
Nov 30 09:19:36 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:19:36 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:19:36 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:19:36 user nova-compute[75340]:     </memballoon>
Nov 30 09:19:36 user nova-compute[75340]:   </devices>
Nov 30 09:19:36 user nova-compute[75340]: </domain>
Nov 30 09:19:36 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-416755434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_vif [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb7f67b5-824f-5474-8876-4c48c7c78224', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f89c78c-5b, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f89c78c-5b, col_values=(('qos', UUID('d227cb21-faca-4895-8977-9fd2b613717d')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f89c78c-5b, col_values=(('external_ids', {'iface-id': '7f89c78c-5bf5-4138-858a-01076110bea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:78:31', 'vm-uuid': '279b49b7-6b6f-4d14-bc3a-ae18849bf122'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:36 user nova-compute[75340]: INFO os_vif [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b')
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:36 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Took 0.78 seconds to deallocate network for instance.
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] No VIF found with MAC fa:16:3e:e9:78:31, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYgzuvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:36 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:36 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:36 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:19:36 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Deleted allocations for instance 30737691-a43b-44ec-93c2-b66868d553ac
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d29819-da6d-4e84-94e7-946366b7b9ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:19:36 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d5c30-5687-4690-a131-899ad828f81e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a] added
Nov 30 09:19:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbdc62-151b-4f72-9b00-ad55d7971e5d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c0d55fda-0380-45b0-a454-f3ef95704c63 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "30737691-a43b-44ec-93c2-b66868d553ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1576348-13eb-4c4c-982c-075ff858a8fb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYgzuvaA {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYgzuvaA" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[80661383-97ca-4c75-9d94-babb441474c4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYgzuvaA'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6de255-2cf0-46f2-8419-592600a25f17]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] Acquiring lock "30737691-a43b-44ec-93c2-b66868d553ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] Lock "30737691-a43b-44ec-93c2-b66868d553ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] No waiting events found dispatching network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:36 user nova-compute[75340]: WARNING nova.compute.manager [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received unexpected event network-vif-plugged-41652583-81c1-4a67-b474-8231b70b84aa for instance with vm_state deleted and task_state None.
Nov 30 09:19:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-02cfb5af-adb2-4b74-b05c-f153f52419c6 req-cc2d9bcd-1365-45a5-8dca-764a92f1ec1d service nova] [instance: 30737691-a43b-44ec-93c2-b66868d553ac] Received event network-vif-deleted-41652583-81c1-4a67-b474-8231b70b84aa {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a6f6c-02d9-473f-a9b3-a9b7396a7554]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:36 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:36 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:36 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:36 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70cc60-88a3-4778-ac3f-aec08fd56d9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260]
Nov 30 09:19:37 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260] successful.
Nov 30 09:19:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a1fb3-60e5-4aac-b82a-532f573a4e7d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5318884-920b-448c-9482-bad98574d632]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:37 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb69bbf-7d81-43c0-87e5-ee1b0262ef1f]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:37 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYgzuvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23839666431396233', 'path': '/dev/sde'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839666431396233', 'path': '/dev/sde'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:19:38 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:19:38 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:19:38 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:19:38 user nova-compute[75340]:   <serial>415a56d6-6871-4721-bc9c-b7b66b290a2a</serial>
Nov 30 09:19:38 user nova-compute[75340]: </disk>
Nov 30 09:19:38 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No VIF found with MAC fa:16:3e:0c:2f:e4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5fb577ae-a821-440d-88fa-3cb0bc7775c4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.642s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:39 user nova-compute[75340]: WARNING nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state building and task_state spawning.
Nov 30 09:19:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:39 user nova-compute[75340]: WARNING nova.compute.manager [req-ebb3f0a4-f52c-4dc5-ad21-41a7c6f9b01d req-9467d2f6-9b08-4d8e-a455-457ed9cf21a7 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state building and task_state spawning.
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:19:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance spawned successfully.
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Port 4948b73b-dc7f-4720-8006-1232706b4aac binding to destination host user is already ACTIVE {{(pid=75340) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:19:40 user nova-compute[75340]: INFO nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 30 09:19:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:40 user nova-compute[75340]: INFO nova.compute.manager [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Took 19.69 seconds to build instance.
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e83bdad8-9ba0-4ed4-84ac-e3446ecd6f1e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.812s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Creating tmpfile /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/tmp_2t8agsx to verify with other compute node that the instance is on the same shared storage. {{(pid=75340) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:41 user nova-compute[75340]: WARNING nova.compute.manager [req-26c08a86-da65-468c-95f5-03d7280b73a1 req-afb967bf-af87-40a9-9b3c-00201fd3a168 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state resized and task_state resize_reverting.
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance destroyed successfully.
Nov 30 09:19:41 user nova-compute[75340]: DEBUG nova.objects.instance [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'resources' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4948b73b-dc, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40bf5e14-d665-42f0-8d6e-8a4cc3fb7aac) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:42 user nova-compute[75340]: INFO os_vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:42 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a8416-7942-499f-9c15-62470d2e58f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:19:42 user nova-compute[75340]: No targets found.
Nov 30 09:19:42 user nova-compute[75340]: iSNS:
Nov 30 09:19:42 user nova-compute[75340]: No targets found.
Nov 30 09:19:42 user nova-compute[75340]: STATIC:
Nov 30 09:19:42 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:19:42 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:42 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:42 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:19:42 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:42 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:42 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:19:42 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:42 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:42 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:19:42 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:19:42 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:19:42 user nova-compute[75340]: FIRMWARE:
Nov 30 09:19:42 user nova-compute[75340]: No targets found.
Nov 30 09:19:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:19:42 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:19:42 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[604edf65-9bbd-424c-a7a7-c9aa052c46be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[69610491-cde2-4235-8c16-eba2d1d643ef]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:42 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cebf951-663f-429f-a281-e004cbb38ee5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[647bab1e-27e4-4c6a-861f-cc4b20e0f6db]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b98bea-a46e-4eb4-8e9c-b1672894acc8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[337dc047-ab5f-4a5f-ba38-827796c393ac]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda0a0b-4f7e-4071-aeae-30525fa7b595]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad3270-bb17-4f1c-8783-271cc784880a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:19:42 user nova-compute[75340]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:19:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c50b8-9c56-429e-ab89-43ccec15b382]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== disconnect_volume: return (384ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:19:43 user nova-compute[75340]: WARNING nova.compute.manager [req-37eed85f-ed5e-48de-b39e-011108779d81 req-3a78d55d-c95b-4250-9b7a-26b73821526f service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state resized and task_state resize_reverting.
Nov 30 09:19:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:19:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7033MB free_disk=25.35169219970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Applying migration context for instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 as it has an incoming, in-progress migration 39f44288-573c-4c17-944f-cd58a1a2d944. Migration status is reverting {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 09:19:44 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating resource usage from migration 39f44288-573c-4c17-944f-cd58a1a2d944
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance b2d40060-d7cc-4038-9f91-8551ba7576f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Migration 39f44288-573c-4c17-944f-cd58a1a2d944 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c6ff93f6-b93f-4898-a587-9c74b3002b8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2cba226e-fba2-424f-8be1-82700df03360 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.874s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:19:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'migration_context' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG nova.objects.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Object Instance<cd3f40a8-6a0f-4116-b654-e222153dd2a4> lazy-loaded attributes: resources,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:19:46 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79404d38-05d6-4aec-a35b-b01660694d2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:19:46 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7e201-f1a8-435e-ad99-d3d9ec2baa7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2] added
Nov 30 09:19:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7bdaa3-6e57-44de-8e77-b0e7b54a5e8e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da05973-c303-4cb5-baf2-213e1d1e83ef]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:19:46 user nova-compute[75340]: INFO nova.compute.manager [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attaching volume ed4cabfc-5867-4e87-a643-2f5e2de95ecb to /dev/vdc
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHwlUaBn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHwlUaBn" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b7c5b-2bac-48d7-a0ec-8fe6e5cb5d92]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eHwlUaBn'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760e96c-a531-4173-8343-206e83047b8f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.utils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc7881-0bc4-4c09-ba6c-2489c63ae840]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f810b8-fffb-40aa-a393-93740817d34f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:46 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:46 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:46 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:46 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[795e2390-e0d8-4ce8-8b53-91a9a7d870e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[14566765-d0f0-41d1-b054-5ddcfef29675]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790b911-8f96-42ab-be12-cf0201486fd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96df893-1d6a-4a13-9bff-08b2e553366f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]
Nov 30 09:19:47 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:19:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:47 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b84199-1f1f-434a-896b-1adca4a64a86]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.utils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating existing volume attachment record: b7de8f62-e0c4-49c7-b603-3e96ffdaf057 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad920d6-dd26-4c34-bbe8-8ddfe2c762e2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a25edb-641c-4241-b3b4-ff8a47d4cdba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:19:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:19:47 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:19:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[889261d1-5e44-4765-886a-b7ce7999f0e8]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.602s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:47 user nova-compute[75340]: INFO nova.compute.manager [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Swapping old allocation on dict_keys(['0b79bb92-a015-438b-9e5d-504678a00853']) held by migration 39f44288-573c-4c17-944f-cd58a1a2d944 for instance
Nov 30 09:19:47 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Overwriting current allocation {'allocations': {'0b79bb92-a015-438b-9e5d-504678a00853': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': '082add99abc342f9aa296b611fd4cb85', 'user_id': 'aeac2f0e248940b1b494f96c8e7535d5', 'consumer_generation': 1} on consumer cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquired lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:19:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23062336130386663', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062336130386663', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Releasing lock "refresh_cache-cd3f40a8-6a0f-4116-b654-e222153dd2a4" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.utils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.objects.instance [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'flavor' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f98145-8408-4b54-b4d8-10f1aa49762a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539e9de-78c8-4fe2-8805-f676529ff1ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:19:48 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:19:48 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:19:48 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:19:48 user nova-compute[75340]:   <serial>a5b125b8-d57c-4de9-89ea-0a0d34a387d2</serial>
Nov 30 09:19:48 user nova-compute[75340]: </disk>
Nov 30 09:19:48 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb96c13-6ec8-45eb-ae3e-c4005f453ee3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fbe7b-1624-4632-9f07-8db7b3c564ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:48 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:48 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0c522-0372-4542-96c8-cff63480590c]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG os_brick.utils [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:19:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:06:c9:68, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37791264-53cf-45b5-9bf3-39ef202527b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.296s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:19:51 user nova-compute[75340]: INFO nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Booting with volume 9e03a247-308d-40a2-8620-e351bed8e1d0 at /dev/vdc
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849e97b-3064-4f04-a831-8d280f9104e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04736324-78fd-4f19-86d2-3e7bff900875]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eaeca9-608c-41f2-905d-59400ec72d25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1957e571-e4dd-4c86-98c3-d0e43a34e0ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:19:51 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:19:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[28592506-a94d-4aa3-93f2-d48f79f6c39e]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:19:51 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating existing volume attachment record: 65a5e459-a65e-4854-96a3-4f911e70e223 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:19:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:19:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:03 user nova-compute[75340]: INFO nova.compute.manager [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Rebuilding instance
Nov 30 09:20:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:20:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Creating image(s)
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Ensure instance console log exists: /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Start _get_guest_xml network_info=[{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '1bfcd053-6513-4bc5-8c22-d4e8611219e8', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZpoSzaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cba226e-fba2-424f-8be1-82700df03360', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7254610-c0e8-489a-9969-d0600d8c1acb', 'serial': 'a7254610-c0e8-489a-9969-d0600d8c1acb'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '3a5832f4-0cac-4526-a4a9-418094f51c46', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxWhVkdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cba226e-fba2-424f-8be1-82700df03360', 'attached_at': '', 'detached_at': '', 'volume_id': '23bf61d5-c83d-46d3-b268-ba003594e97c', 'serial': '23bf61d5-c83d-46d3-b268-ba003594e97c'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '65a5e459-a65e-4854-96a3-4f911e70e223', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNOtveVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cba226e-fba2-424f-8be1-82700df03360', 'attached_at': '', 'detached_at': '', 'volume_id': '9e03a247-308d-40a2-8620-e351bed8e1d0', 'serial': '9e03a247-308d-40a2-8620-e351bed8e1d0'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZpoSzaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:03 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8562abdc-11b4-42ec-b137-e4e57638a2b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:03 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b9096f-fcbb-4cab-88cf-0163e897358e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb] added
Nov 30 09:20:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc82512-c650-4dc1-8164-b7b698d5c834]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a7ecec-bc56-49ad-8b90-30fcf46b6900]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZpoSzaV {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZpoSzaV" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f3a85-1d45-4322-a6af-128ba888a7ad]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vZpoSzaV'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7709191-89b0-4b36-b233-5231bb286a0f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de6e1b-d111-4834-8a51-9bd00d2c5209]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:03 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b734943-dae6-47b4-b621-bafc9b75ed42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260]
Nov 30 09:20:03 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf9e10-3cd2-4482-8a81-d3d320f3b68d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d901d5a-e0ea-415a-96f2-2890f3d92a4f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:04 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:04 user nova-compute[75340]: WARNING nova.compute.manager [req-512a2dc7-785f-425a-8418-d7941a45ed46 req-de60de2f-24ca-4878-b85a-b04a047c33bc service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state active and task_state rebuilding.
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2dc0a-f87f-43ef-a534-d4edc1251211]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZpoSzaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance destroyed successfully.
Nov 30 09:20:04 user nova-compute[75340]: INFO nova.compute.manager [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Detaching volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:20:04 user nova-compute[75340]: INFO nova.virt.block_device [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attempting to driver detach volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2 from mountpoint /dev/vdb
Nov 30 09:20:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Attempting to detach device vdb from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:20:04 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:04 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:20:04 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:20:04 user nova-compute[75340]:   <serial>a5b125b8-d57c-4de9-89ea-0a0d34a387d2</serial>
Nov 30 09:20:04 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:20:04 user nova-compute[75340]: </disk>
Nov 30 09:20:04 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:20:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully detached device vdb from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the persistent domain config.
Nov 30 09:20:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:20:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23433653564656664', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433653564656664', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.348s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxWhVkdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96cea00-b9d5-4190-b31b-d1f3361a7f1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:20:05 user nova-compute[75340]: No targets found.
Nov 30 09:20:05 user nova-compute[75340]: iSNS:
Nov 30 09:20:05 user nova-compute[75340]: No targets found.
Nov 30 09:20:05 user nova-compute[75340]: STATIC:
Nov 30 09:20:05 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:20:05 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:05 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:05 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:20:05 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:05 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:05 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:20:05 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:05 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:05 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:20:05 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:05 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:05 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:20:05 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:05 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:05 user nova-compute[75340]: FIRMWARE:
Nov 30 09:20:05 user nova-compute[75340]: No targets found.
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:20:05 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:20:05 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454cf54-7e60-42f7-a410-002b58d81670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6215f31-366e-412a-a74b-19af18cb87fa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff306bb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac40b8-882d-483c-afb1-b80e7e41bc9c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a480e1f-cd2a-4046-89eb-073681c3efae]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[57230859-d02b-402c-92a6-3cfe2a9e29a6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0620496-20d1-4d14-9454-c4e324e4fa02]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[318beaf8-5b33-4dd8-85c2-e896c90836cc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0addcda4-dd0d-40b3-a7dd-b7e0fdf69abd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]
Nov 30 09:20:05 user nova-compute[75340]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[313cb63c-4bcc-4911-b44c-dbbad7541227]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== disconnect_volume: return (680ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.311s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:05 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956f798-3f98-4198-8387-0470c6025834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:05 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83d53a-1062-4e74-8e24-40e56cc189af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c] added
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e9725-3445-4a57-8e6b-78ace6833813]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f7e7af-d875-4e29-ad63-5efc628c1efd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxWhVkdH {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxWhVkdH" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b5aa5-f4a4-47a8-be7a-0dc71e1297e2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxWhVkdH'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193f61a-f405-498b-89c4-1f1955582a47]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3893e775-a83a-400d-b665-cde117503da1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1fd9b-629b-4d09-bfca-6d9216fb41f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260]
Nov 30 09:20:05 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf00066-a5a3-4544-8c22-44b8461c9669]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08fa1f1-7e4a-4535-8941-58329435b22e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:05 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196e05d-f618-4912-9b36-de4c0280ab61]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBLTSmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Starting finish_revert_migration {{(pid=75340) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start _get_guest_xml network_info=[{"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'b397d7cf-ff09-4dba-a2f0-921ff4ed72e2', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cd3f40a8-6a0f-4116-b654-e222153dd2a4', 'attached_at': '2023-11-30T09:20:06.000000', 'detached_at': '', 'volume_id': 'efd4dbce-d836-491d-9109-cf96338dbcaf', 'serial': 'efd4dbce-d836-491d-9109-cf96338dbcaf'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'vcpu_model' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING nova.compute.manager [req-ddfd065c-5c5b-45ee-b271-f188f7de86af req-db79bac2-7942-4eef-a77c-9487524c10cf service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state active and task_state rebuilding.
Nov 30 09:20:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance destroyed successfully.
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-ServerActionsTestOtherA-server-1218651476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738e3ea5-c7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=069de02b-a2d0-45dd-93a5-65ceda23f2e8) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:06 user nova-compute[75340]: INFO os_vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7')
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxWhVkdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== connect_volume: return (1648ms) {'type': 'block', 'scsi_wwn': '23535623132633439', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535623132633439', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.843s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:06 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8246d-bc32-4b38-b0ae-23534ae7947e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:06 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNOtveVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba64f0f-2d30-452f-8416-2ea73cd1cee4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb] added
Nov 30 09:20:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3e0ea-9ff6-4be2-9e8c-4102a76e41fc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404a454-8c4f-48c8-b993-7aab9cf258c0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBLTSmhZ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBLTSmhZ" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f46511-3b79-45b2-9f99-bcf7c1996474]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBLTSmhZ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b998b2-a639-4620-b4ad-a96aa06310ec]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd3b018-cbb2-4fa4-a73a-291d56e17483]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:06 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb53210-18cc-494c-86e0-5112c443ee59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260]
Nov 30 09:20:06 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ad73f-69ae-4d67-b374-29490c338134]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[575bd617-ed06-4601-abc4-1fb90c8b8e08]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:07 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:07 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:07 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238c4dc-c7cf-49ea-acf6-74e6846d452f]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBLTSmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== connect_volume: return (2195ms) {'type': 'block', 'scsi_wwn': '26337353032643162', 'path': '/dev/sdg'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337353032643162', 'path': '/dev/sdg'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.963s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:08 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:08 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a4be2-7a45-45e1-ada1-129f922e24a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:08 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:20:08 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:08 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:20:08 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:20:08 user nova-compute[75340]:   <serial>ed4cabfc-5867-4e87-a643-2f5e2de95ecb</serial>
Nov 30 09:20:08 user nova-compute[75340]: </disk>
Nov 30 09:20:08 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[880a0e2f-0df3-4b70-88ef-8acf066e612d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf] added
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6736ddf1-9225-4205-8e66-4ae9870145e8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:08 user nova-compute[75340]: INFO nova.compute.manager [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Terminating instance
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[29432219-7c8c-4358-bfed-cf055b676067]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StPFBMKc" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51e636-37c2-4924-bc3b-d050826dd67e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StPFBMKc'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f8621a-9511-49cb-b625-5f7baed5c2a6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b65698-2450-4de8-8e58-47805ee60d27]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[558e6db5-baba-4ac6-beb8-a2b2f370be46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:20:08 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[943cde06-fae6-4510-bfe2-72d1767a4e1e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[511878ce-1399-401d-b1f6-33d39a0d92c5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:08 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9a5e4-1d18-4a5e-a8ce-c475a4c36e44]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-unplugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] No waiting events found dispatching network-vif-unplugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b2d2db0-5231-47f3-a14a-b6b91968bbaf req-bc666c28-d520-4f23-a377-15468e6012c5 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-unplugged-8ba14a9a-668f-409f-9cfd-de357918856b for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] No VIF found with MAC fa:16:3e:0c:2f:e4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-48b8ee0b-bd77-42ba-a97b-bd5df6818fb4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.892s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Instance destroyed successfully.
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lazy-loading 'resources' on Instance uuid b2d40060-d7cc-4038-9f91-8551ba7576f9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-641821850',display_name='tempest-VolumesAdminNegativeTest-server-641821850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-641821850',id=8,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrTe6b+dpPCj9qjMocTRv7UkLOSWB8ZY+Co8xRvArvTrD8x9w2t4u4UXXWgrywSeMMtmt1Q5DRFDjj5zKsJdWYWpYYDBx3AlQbwKStIPoI2xct/HFoQc89VAgrdEXH45A==',key_name='tempest-keypair-410102207',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6721267c2994f9b9af9947a9e228d72',ramdisk_id='',reservation_id='r-mup99wfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1287326145',owner_user_name='tempest-VolumesAdminNegativeTest-1287326145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5b50ed776a541748fbfc920306c4f43',uuid=b2d40060-d7cc-4038-9f91-8551ba7576f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converting VIF {"id": "8ba14a9a-668f-409f-9cfd-de357918856b", "address": "fa:16:3e:c1:19:91", "network": {"id": "cac6065b-9412-414b-83b9-c473cf25287f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-334522370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6721267c2994f9b9af9947a9e228d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba14a9a-66", "ovs_interfaceid": "8ba14a9a-668f-409f-9cfd-de357918856b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG os_vif [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba14a9a-66, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01aedf94-314e-474f-8820-d6bd020a426b) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:08 user nova-compute[75340]: INFO os_vif [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:19:91,bridge_name='br-int',has_traffic_filtering=True,id=8ba14a9a-668f-409f-9cfd-de357918856b,network=Network(cac6065b-9412-414b-83b9-c473cf25287f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba14a9a-66')
Nov 30 09:20:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Deleting instance files /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9_del
Nov 30 09:20:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Deletion of /opt/stack/data/nova/instances/b2d40060-d7cc-4038-9f91-8551ba7576f9_del complete
Nov 30 09:20:09 user nova-compute[75340]: INFO nova.compute.manager [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== connect_volume: return (3368ms) {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdh'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334613232343435', 'path': '/dev/sdh'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.116s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c90c869-68eb-4b34-9e47-4ae5869083e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:20:09 user nova-compute[75340]: No targets found.
Nov 30 09:20:09 user nova-compute[75340]: iSNS:
Nov 30 09:20:09 user nova-compute[75340]: No targets found.
Nov 30 09:20:09 user nova-compute[75340]: STATIC:
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:20:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:09 user nova-compute[75340]: FIRMWARE:
Nov 30 09:20:09 user nova-compute[75340]: No targets found.
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:20:09 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:20:09 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:20:09 user nova-compute[75340]:   <uuid>cd3f40a8-6a0f-4116-b654-e222153dd2a4</uuid>
Nov 30 09:20:09 user nova-compute[75340]:   <name>instance-00000005</name>
Nov 30 09:20:09 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:20:09 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:20:09 user nova-compute[75340]:   <metadata>
Nov 30 09:20:09 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:20:09 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherB-server-1737055794</nova:name>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:20:06</nova:creationTime>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:20:09 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:20:09 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:owner>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:user uuid="aeac2f0e248940b1b494f96c8e7535d5">tempest-ServerActionsTestOtherB-642872739-project-member</nova:user>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:project uuid="082add99abc342f9aa296b611fd4cb85">tempest-ServerActionsTestOtherB-642872739</nova:project>
Nov 30 09:20:09 user nova-compute[75340]:       </nova:owner>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:20:09 user nova-compute[75340]:       <nova:ports>
Nov 30 09:20:09 user nova-compute[75340]:         <nova:port uuid="4948b73b-dc7f-4720-8006-1232706b4aac">
Nov 30 09:20:09 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:20:09 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:09 user nova-compute[75340]:       </nova:ports>
Nov 30 09:20:09 user nova-compute[75340]:     </nova:instance>
Nov 30 09:20:09 user nova-compute[75340]:   </metadata>
Nov 30 09:20:09 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:20:09 user nova-compute[75340]:     <system>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="serial">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="uuid">cd3f40a8-6a0f-4116-b654-e222153dd2a4</entry>
Nov 30 09:20:09 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:20:09 user nova-compute[75340]:     </system>
Nov 30 09:20:09 user nova-compute[75340]:   </sysinfo>
Nov 30 09:20:09 user nova-compute[75340]:   <os>
Nov 30 09:20:09 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:20:09 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:20:09 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:20:09 user nova-compute[75340]:   </os>
Nov 30 09:20:09 user nova-compute[75340]:   <features>
Nov 30 09:20:09 user nova-compute[75340]:     <acpi/>
Nov 30 09:20:09 user nova-compute[75340]:     <apic/>
Nov 30 09:20:09 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:20:09 user nova-compute[75340]:   </features>
Nov 30 09:20:09 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:20:09 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:20:09 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:20:09 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:20:09 user nova-compute[75340]:   </clock>
Nov 30 09:20:09 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:20:09 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:20:09 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:20:09 user nova-compute[75340]:   </cpu>
Nov 30 09:20:09 user nova-compute[75340]:   <devices>
Nov 30 09:20:09 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:20:09 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:20:09 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk"/>
Nov 30 09:20:09 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:20:09 user nova-compute[75340]:     </disk>
Nov 30 09:20:09 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:20:09 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:09 user nova-compute[75340]:       <source dev="/dev/sdh"/>
Nov 30 09:20:09 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:20:09 user nova-compute[75340]:       <serial>efd4dbce-d836-491d-9109-cf96338dbcaf</serial>
Nov 30 09:20:09 user nova-compute[75340]:     </disk>
Nov 30 09:20:09 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:09 user nova-compute[75340]:       <mac address="fa:16:3e:f5:c0:76"/>
Nov 30 09:20:09 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:09 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:09 user nova-compute[75340]:       <target dev="tap4948b73b-dc"/>
Nov 30 09:20:09 user nova-compute[75340]:     </interface>
Nov 30 09:20:09 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:20:09 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/console.log" append="off"/>
Nov 30 09:20:09 user nova-compute[75340]:     </serial>
Nov 30 09:20:09 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:20:09 user nova-compute[75340]:     <video>
Nov 30 09:20:09 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:09 user nova-compute[75340]:     </video>
Nov 30 09:20:09 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:20:09 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:20:09 user nova-compute[75340]:     </rng>
Nov 30 09:20:09 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:20:09 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:20:09 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:20:09 user nova-compute[75340]:     </memballoon>
Nov 30 09:20:09 user nova-compute[75340]:   </devices>
Nov 30 09:20:09 user nova-compute[75340]: </domain>
Nov 30 09:20:09 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '494210f0-3a33-59bb-8377-c4cfecdc7f41', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517219f-288e-46ec-9c97-dcc9689080c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4948b73b-dc, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4948b73b-dc, col_values=(('qos', UUID('6a097f60-58c3-4bf9-a90e-b47592b766e2')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4948b73b-dc, col_values=(('external_ids', {'iface-id': '4948b73b-dc7f-4720-8006-1232706b4aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:76', 'vm-uuid': 'cd3f40a8-6a0f-4116-b654-e222153dd2a4'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:09 user nova-compute[75340]: INFO os_vif [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b133433-8baa-445d-84cd-9f014d167553]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5026d240>, {}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Disconnecting from: [] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== disconnect_volume: return (3206ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:20:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Deleting instance files /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4_del
Nov 30 09:20:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Deletion of /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4_del complete
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.831s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:09 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d7954-463d-457b-92e2-d8315c259b7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:09 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265cbeb-5e2d-4a56-9469-99056d73a4cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0] added
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8e4c67-f02b-4b65-92af-060a62051386]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[771b73d3-00d3-4fee-845a-5eaea8f6bb62]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNOtveVA {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: INFO nova.virt.block_device [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Booting with volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2 at /dev/vdb
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNOtveVA" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e9653-6c86-4cf1-8410-55b5b3a4f15f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNOtveVA'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[947584f4-246a-4fe3-b00c-7af0dfd97724]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.utils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7714a2a-7a94-4181-a327-f5eab716965e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:09 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f07a8-2cb0-4546-a06a-856f7f4da7ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8d3be-c783-48ca-b24f-4aaf19a6e96f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabbeec8-d47c-4443-94a1-faf84ef653f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f88c4-9b01-4b42-b174-ae999bb298d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f392aae-c0f0-43dd-9181-c6315310fe76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260]
Nov 30 09:20:09 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:20:09 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6576927-e0e3-44c9-b0a6-91124b1419b0]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.utils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating existing volume attachment record: 41935f08-3203-4264-9fb5-1802391400d1 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e9c0b-5026-42fb-b627-3125b0d7fd53]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:09 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Took 0.94 seconds to deallocate network for instance.
Nov 30 09:20:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10debef-735f-4545-89bf-d79be70d9db6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:10 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2783d42-5f10-4cd2-ab24-270d59f56f41]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNOtveVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:10 user nova-compute[75340]: INFO nova.compute.manager [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Detaching volume ed4cabfc-5867-4e87-a643-2f5e2de95ecb
Nov 30 09:20:10 user nova-compute[75340]: INFO nova.virt.block_device [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attempting to driver detach volume ed4cabfc-5867-4e87-a643-2f5e2de95ecb from mountpoint /dev/vdc
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Attempting to detach device vdc from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:20:10 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:10 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:20:10 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:20:10 user nova-compute[75340]:   <serial>ed4cabfc-5867-4e87-a643-2f5e2de95ecb</serial>
Nov 30 09:20:10 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:20:10 user nova-compute[75340]: </disk>
Nov 30 09:20:10 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:20:10 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully detached device vdc from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the persistent domain config.
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:20:10 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:10 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:20:10 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:20:10 user nova-compute[75340]:   <serial>ed4cabfc-5867-4e87-a643-2f5e2de95ecb</serial>
Nov 30 09:20:10 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:20:10 user nova-compute[75340]: </disk>
Nov 30 09:20:10 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] Acquiring lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] No waiting events found dispatching network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:10 user nova-compute[75340]: WARNING nova.compute.manager [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received unexpected event network-vif-plugged-8ba14a9a-668f-409f-9cfd-de357918856b for instance with vm_state deleted and task_state None.
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-22939d73-72a6-469f-8dba-db5c2fcfc64d req-aaebd820-38e7-4019-8788-58d1f4c996c9 service nova] [instance: b2d40060-d7cc-4038-9f91-8551ba7576f9] Received event network-vif-deleted-8ba14a9a-668f-409f-9cfd-de357918856b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:10 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Deleted allocations for instance b2d40060-d7cc-4038-9f91-8551ba7576f9
Nov 30 09:20:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-755ee9de-90a7-484f-9208-a5f78ebafc25 tempest-VolumesAdminNegativeTest-1287326145 tempest-VolumesAdminNegativeTest-1287326145-project-member] Lock "b2d40060-d7cc-4038-9f91-8551ba7576f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== connect_volume: return (4308ms) {'type': 'block', 'scsi_wwn': '23034363233333931', 'path': '/dev/sdi'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034363233333931', 'path': '/dev/sdi'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cba226e-fba2-424f-8be1-82700df03360 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:20:11 user nova-compute[75340]:   <uuid>2cba226e-fba2-424f-8be1-82700df03360</uuid>
Nov 30 09:20:11 user nova-compute[75340]:   <name>instance-00000016</name>
Nov 30 09:20:11 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:20:11 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:20:11 user nova-compute[75340]:   <metadata>
Nov 30 09:20:11 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:20:11 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:name>tempest-device-tagging-server-1647921727</nova:name>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:20:03</nova:creationTime>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:20:11 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:20:11 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:owner>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:user uuid="b0df98d618a24eeaa3177dbfa0c34b10">tempest-TaggedBootDevicesTest_v242-841004651-project-member</nova:user>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:project uuid="b3e48df89a5f4191baf8803d1fce4543">tempest-TaggedBootDevicesTest_v242-841004651</nova:project>
Nov 30 09:20:11 user nova-compute[75340]:       </nova:owner>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:20:11 user nova-compute[75340]:       <nova:ports>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="f8013651-1781-4640-ab51-752ffb484494">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="852297e3-9240-407e-b53b-d5e45cd80f87">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="c3d4f3e2-52a0-4af7-96ac-cc442a708403">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="ed449386-4cd7-4e58-aee3-c2318e4f55ca">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="db87c456-e7c1-4344-91fe-c6f5d61cf22d">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:         <nova:port uuid="38c38183-8c09-4e61-ba91-a2bbda235541">
Nov 30 09:20:11 user nova-compute[75340]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 09:20:11 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:11 user nova-compute[75340]:       </nova:ports>
Nov 30 09:20:11 user nova-compute[75340]:     </nova:instance>
Nov 30 09:20:11 user nova-compute[75340]:   </metadata>
Nov 30 09:20:11 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:20:11 user nova-compute[75340]:     <system>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="serial">2cba226e-fba2-424f-8be1-82700df03360</entry>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="uuid">2cba226e-fba2-424f-8be1-82700df03360</entry>
Nov 30 09:20:11 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:20:11 user nova-compute[75340]:     </system>
Nov 30 09:20:11 user nova-compute[75340]:   </sysinfo>
Nov 30 09:20:11 user nova-compute[75340]:   <os>
Nov 30 09:20:11 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:20:11 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:20:11 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:20:11 user nova-compute[75340]:   </os>
Nov 30 09:20:11 user nova-compute[75340]:   <features>
Nov 30 09:20:11 user nova-compute[75340]:     <acpi/>
Nov 30 09:20:11 user nova-compute[75340]:     <apic/>
Nov 30 09:20:11 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:20:11 user nova-compute[75340]:   </features>
Nov 30 09:20:11 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:20:11 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:20:11 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:20:11 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:20:11 user nova-compute[75340]:   </clock>
Nov 30 09:20:11 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:20:11 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:20:11 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:20:11 user nova-compute[75340]:   </cpu>
Nov 30 09:20:11 user nova-compute[75340]:   <devices>
Nov 30 09:20:11 user nova-compute[75340]:     <disk type="file" device="cdrom">
Nov 30 09:20:11 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 09:20:11 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/disk.config"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="hda" bus="ide"/>
Nov 30 09:20:11 user nova-compute[75340]:     </disk>
Nov 30 09:20:11 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:20:11 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:11 user nova-compute[75340]:       <source dev="/dev/sdf"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <serial>a7254610-c0e8-489a-9969-d0600d8c1acb</serial>
Nov 30 09:20:11 user nova-compute[75340]:     </disk>
Nov 30 09:20:11 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:20:11 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:11 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <serial>23bf61d5-c83d-46d3-b268-ba003594e97c</serial>
Nov 30 09:20:11 user nova-compute[75340]:     </disk>
Nov 30 09:20:11 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:20:11 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:11 user nova-compute[75340]:       <source dev="/dev/sdi"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="vdc" bus="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <serial>9e03a247-308d-40a2-8620-e351bed8e1d0</serial>
Nov 30 09:20:11 user nova-compute[75340]:     </disk>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:db:fb:55"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tapf8013651-17"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:85:de:f8"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tap852297e3-92"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:aa:aa:64"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tapdde7a901-d0"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:93:6c:05"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tapc3d4f3e2-52"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:f3:3c:73"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="taped449386-4c"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:21:7b:c4"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tapdb87c456-e7"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:11 user nova-compute[75340]:       <mac address="fa:16:3e:15:96:d2"/>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:11 user nova-compute[75340]:       <target dev="tap38c38183-8c"/>
Nov 30 09:20:11 user nova-compute[75340]:     </interface>
Nov 30 09:20:11 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:20:11 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/console.log" append="off"/>
Nov 30 09:20:11 user nova-compute[75340]:     </serial>
Nov 30 09:20:11 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:20:11 user nova-compute[75340]:     <video>
Nov 30 09:20:11 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:11 user nova-compute[75340]:     </video>
Nov 30 09:20:11 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:20:11 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:20:11 user nova-compute[75340]:     </rng>
Nov 30 09:20:11 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:20:11 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:20:11 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:20:11 user nova-compute[75340]:     </memballoon>
Nov 30 09:20:11 user nova-compute[75340]:   </devices>
Nov 30 09:20:11 user nova-compute[75340]: </domain>
Nov 30 09:20:11 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3e57d37-2b51-510f-970a-a3b65b2ca3de', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8013651-17, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8013651-17, col_values=(('qos', UUID('5ecb2ee5-a621-492f-b334-4dde8dff0958')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8013651-17, col_values=(('external_ids', {'iface-id': 'f8013651-1781-4640-ab51-752ffb484494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:fb:55', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c5862ca-9e62-5158-9853-f744c8abb16e', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852297e3-92, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap852297e3-92, col_values=(('qos', UUID('5723eda5-2357-4018-b435-b14e1d517e19')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap852297e3-92, col_values=(('external_ids', {'iface-id': '852297e3-9240-407e-b53b-d5e45cd80f87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:de:f8', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb774805-78fa-5baf-aebf-777832483443', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdde7a901-d0, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdde7a901-d0, col_values=(('qos', UUID('5714a5bf-c9fd-499d-92f6-f1bcfc0bb4a5')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdde7a901-d0, col_values=(('external_ids', {'iface-id': 'dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:aa:64', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38ce04e9-c063-51f5-91ad-4b48a1bb07eb', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d4f3e2-52, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d4f3e2-52, col_values=(('qos', UUID('282eca7f-1446-42b9-8470-4a9f42a7f2fe')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d4f3e2-52, col_values=(('external_ids', {'iface-id': 'c3d4f3e2-52a0-4af7-96ac-cc442a708403', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:6c:05', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8e5d08d-c7ce-5321-9705-f75fbe053ae8', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped449386-4c, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped449386-4c, col_values=(('qos', UUID('fc5bc971-761a-4d45-80fd-2b47b64bfcdc')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped449386-4c, col_values=(('external_ids', {'iface-id': 'ed449386-4cd7-4e58-aee3-c2318e4f55ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:3c:73', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83d4c173-e711-5afa-a37d-eed7c6d93526', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:11 user nova-compute[75340]: WARNING nova.compute.manager [req-a6d68948-efea-40b3-8166-3972ce80757c req-4da71911-816f-4ae1-b152-3a51371f17e4 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state resized and task_state resize_reverting.
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb87c456-e7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb87c456-e7, col_values=(('qos', UUID('f385c7ee-8107-4d5d-a5b2-db8fa60a6b02')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb87c456-e7, col_values=(('external_ids', {'iface-id': 'db87c456-e7c1-4344-91fe-c6f5d61cf22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:7b:c4', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7')
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '347c18f9-fb90-555f-89f6-905a6338134e', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38c38183-8c, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38c38183-8c, col_values=(('qos', UUID('7fee12f6-7f9e-421a-a415-f8ee11d9e28c')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38c38183-8c, col_values=(('external_ids', {'iface-id': '38c38183-8c09-4e61-ba91-a2bbda235541', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:96:d2', 'vm-uuid': '2cba226e-fba2-424f-8be1-82700df03360'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: INFO os_vif [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c')
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] No BDM found with device name hda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] No VIF found with MAC fa:16:3e:db:fb:55, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] No VIF found with MAC fa:16:3e:f3:3c:73, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Using config drive
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Creating config drive at /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/disk.config
Nov 30 09:20:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9qpiiznp {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9qpiiznp" returned: 0 in 0.056s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:13 user nova-compute[75340]: WARNING nova.compute.manager [req-948cfa94-d552-452f-bbb0-0bf1cc1498e2 req-9a4e01af-1ec3-4084-86c4-23f841f3a081 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state resized and task_state resize_reverting.
Nov 30 09:20:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:20:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance running successfully.
Nov 30 09:20:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] finish_revert_migration finished successfully. {{(pid=75340) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:14 user nova-compute[75340]: WARNING nova.compute.manager [req-a0e2480d-f709-4120-a248-01a88f9ebda1 req-256c21e6-8e1f-486e-8dd7-e0b37948e317 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 for instance with vm_state building and task_state spawning.
Nov 30 09:20:14 user nova-compute[75340]: INFO nova.compute.manager [None req-dc320882-bf13-4785-9258-0285e692ae2c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance to original state: 'active'
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:15 user nova-compute[75340]: WARNING nova.compute.manager [req-40511d53-ad2d-4d67-841a-90e1ea44e548 req-cb77da75-3baf-45cc-8a48-d4bc47ed81a8 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 for instance with vm_state building and task_state spawning.
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:15 user nova-compute[75340]: WARNING nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 for instance with vm_state building and task_state spawning.
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:15 user nova-compute[75340]: WARNING nova.compute.manager [req-dcc581b1-0d6e-43f2-9758-5d5cb8448a0e req-7ebd4c8e-630b-4447-8e1f-59bcc8cc08c4 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 for instance with vm_state building and task_state spawning.
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:16 user nova-compute[75340]: WARNING nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 for instance with vm_state building and task_state spawning.
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:16 user nova-compute[75340]: WARNING nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 for instance with vm_state building and task_state spawning.
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:16 user nova-compute[75340]: WARNING nova.compute.manager [req-312cb90e-ea06-4cdb-8d32-b13470a1fa28 req-e1621c1f-e5b1-4d2c-a0ec-da4d7d278b55 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 for instance with vm_state building and task_state spawning.
Nov 30 09:20:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:17 user nova-compute[75340]: WARNING nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 for instance with vm_state building and task_state spawning.
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:17 user nova-compute[75340]: WARNING nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca for instance with vm_state building and task_state spawning.
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:17 user nova-compute[75340]: WARNING nova.compute.manager [req-a1c2e922-61df-403d-bf8e-a30e884d8f8f req-82c70f07-1487-491f-a5b2-b522e8b54489 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca for instance with vm_state building and task_state spawning.
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:18 user nova-compute[75340]: WARNING nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d for instance with vm_state building and task_state spawning.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:18 user nova-compute[75340]: WARNING nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d for instance with vm_state building and task_state spawning.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:18 user nova-compute[75340]: WARNING nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 for instance with vm_state building and task_state spawning.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:18 user nova-compute[75340]: WARNING nova.compute.manager [req-f13cffb2-2840-454a-89cc-dc78c4cb7af5 req-c149375a-9a7a-414f-9265-e19ae1f58283 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 for instance with vm_state building and task_state spawning.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:20:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance spawned successfully.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:18 user nova-compute[75340]: INFO nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Took 15.02 seconds to spawn the instance on the hypervisor.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:18 user nova-compute[75340]: INFO nova.compute.manager [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Took 66.81 seconds to build instance.
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b01564ce-f118-4cd9-8818-da58b5f69b47 tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.916s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:18 user nova-compute[75340]: INFO nova.compute.manager [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Rescuing
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:20:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG nova.network.neutron [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance destroyed successfully.
Nov 30 09:20:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Attempting rescue
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:20:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Creating image(s)
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'trusted_certs' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:20 user nova-compute[75340]: WARNING nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state active and task_state rescuing.
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:20 user nova-compute[75340]: WARNING nova.compute.manager [req-18e6e634-9e8d-4226-974b-10de7812c4a3 req-0cd9e0e7-ca1f-4b05-91d3-9e7c80380548 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state active and task_state rescuing.
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue" returned: 0 in 0.052s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'migration_context' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<029a6160-a6bb-4a6a-ae54-22819e4c4bd9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start _get_guest_xml network_info=[{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:d7:31:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<029a6160-a6bb-4a6a-ae54-22819e4c4bd9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'numa_topology' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<029a6160-a6bb-4a6a-ae54-22819e4c4bd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:20:20 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:20 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<029a6160-a6bb-4a6a-ae54-22819e4c4bd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-64774986',display_name='tempest-ServerRescueNegativeTestJSON-server-64774986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-64774986',id=20,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-yh0scy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:37Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=029a6160-a6bb-4a6a-ae54-22819e4c4bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:d7:31:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:d7:31:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<029a6160-a6bb-4a6a-ae54-22819e4c4bd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:20:20 user nova-compute[75340]:   <uuid>029a6160-a6bb-4a6a-ae54-22819e4c4bd9</uuid>
Nov 30 09:20:20 user nova-compute[75340]:   <name>instance-00000014</name>
Nov 30 09:20:20 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:20:20 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:20:20 user nova-compute[75340]:   <metadata>
Nov 30 09:20:20 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:20:20 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-64774986</nova:name>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:20:20</nova:creationTime>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:20:20 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:20:20 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:owner>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:20:20 user nova-compute[75340]:       </nova:owner>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:20:20 user nova-compute[75340]:       <nova:ports>
Nov 30 09:20:20 user nova-compute[75340]:         <nova:port uuid="a6f97582-065e-4df0-a583-0973a0103911">
Nov 30 09:20:20 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:20:20 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:20 user nova-compute[75340]:       </nova:ports>
Nov 30 09:20:20 user nova-compute[75340]:     </nova:instance>
Nov 30 09:20:20 user nova-compute[75340]:   </metadata>
Nov 30 09:20:20 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:20:20 user nova-compute[75340]:     <system>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="serial">029a6160-a6bb-4a6a-ae54-22819e4c4bd9</entry>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="uuid">029a6160-a6bb-4a6a-ae54-22819e4c4bd9</entry>
Nov 30 09:20:20 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:20:20 user nova-compute[75340]:     </system>
Nov 30 09:20:20 user nova-compute[75340]:   </sysinfo>
Nov 30 09:20:20 user nova-compute[75340]:   <os>
Nov 30 09:20:20 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:20:20 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:20:20 user nova-compute[75340]:   </os>
Nov 30 09:20:20 user nova-compute[75340]:   <features>
Nov 30 09:20:20 user nova-compute[75340]:     <acpi/>
Nov 30 09:20:20 user nova-compute[75340]:     <apic/>
Nov 30 09:20:20 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:20:20 user nova-compute[75340]:   </features>
Nov 30 09:20:20 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:20:20 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:20:20 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:20:20 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:20:20 user nova-compute[75340]:   </clock>
Nov 30 09:20:20 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:20:20 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:20:20 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:20:20 user nova-compute[75340]:   </cpu>
Nov 30 09:20:20 user nova-compute[75340]:   <devices>
Nov 30 09:20:20 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:20:20 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:20:20 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue"/>
Nov 30 09:20:20 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:20:20 user nova-compute[75340]:     </disk>
Nov 30 09:20:20 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:20:20 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:20:20 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk"/>
Nov 30 09:20:20 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:20:20 user nova-compute[75340]:     </disk>
Nov 30 09:20:20 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:20 user nova-compute[75340]:       <mac address="fa:16:3e:d7:31:79"/>
Nov 30 09:20:20 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:20 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:20 user nova-compute[75340]:       <target dev="tapa6f97582-06"/>
Nov 30 09:20:20 user nova-compute[75340]:     </interface>
Nov 30 09:20:20 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:20:20 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/console.log" append="off"/>
Nov 30 09:20:20 user nova-compute[75340]:     </serial>
Nov 30 09:20:20 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:20:20 user nova-compute[75340]:     <video>
Nov 30 09:20:20 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:20 user nova-compute[75340]:     </video>
Nov 30 09:20:20 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:20:20 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:20:20 user nova-compute[75340]:     </rng>
Nov 30 09:20:20 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:20:20 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:20:20 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:20:20 user nova-compute[75340]:     </memballoon>
Nov 30 09:20:20 user nova-compute[75340]:   </devices>
Nov 30 09:20:20 user nova-compute[75340]: </domain>
Nov 30 09:20:20 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:20:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance destroyed successfully.
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:d7:31:79, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:20:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Creating image(s)
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk 1073741824" returned: 0 in 0.049s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Cannot resize image /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Ensure instance console log exists: /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start _get_guest_xml network_info=[{"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '41935f08-3203-4264-9fb5-1802391400d1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9455558a-7e24-449d-a515-436c818bf5c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'serial': 'a5b125b8-d57c-4de9-89ea-0a0d34a387d2'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:20:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 09:20:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:20:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:22 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0058570-c8c8-400e-ab7e-0be8963cf41d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:20:22 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada32bb9-47ae-418a-8560-7042504dc249]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2] added
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[188bbf55-72cc-4f10-8461-77ce2028c31b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9731bbbe-cc97-4e30-847f-5ece3ee2840c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHwlUaBn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHwlUaBn" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b51ae-1646-4f81-aeb3-4d7988213a49]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eHwlUaBn'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe4145-bd64-482f-8b4a-f7eeba009b19]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9455cee6-ee6a-479e-b456-444dd1680bee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f5649-6beb-44b9-b2dd-7792bd69c7f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]
Nov 30 09:20:22 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae46f6-0ff3-4bdf-bd3c-10db52fd47de]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc98d40-5ac2-4b62-84de-1018d0da1e20]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] HCTL ('41', '-', '-', 0) found on session 25 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6010ff-1292-401d-a416-a0bf010122dc]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching for a device in session 25 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:22 user nova-compute[75340]: WARNING nova.compute.manager [req-1915625e-3ea8-414f-aa20-c01f9e7eb395 req-a1d48384-5e33-44f3-8243-65910adf3f26 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state active and task_state rescuing.
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23062336130386663', 'path': '/dev/sdj'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062336130386663', 'path': '/dev/sdj'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-ServerActionsTestOtherA-server-1218651476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:20:23 user nova-compute[75340]:   <uuid>9455558a-7e24-449d-a515-436c818bf5c4</uuid>
Nov 30 09:20:23 user nova-compute[75340]:   <name>instance-00000012</name>
Nov 30 09:20:23 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:20:23 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:20:23 user nova-compute[75340]:   <metadata>
Nov 30 09:20:23 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:20:23 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherA-server-1218651476</nova:name>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:20:21</nova:creationTime>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:20:23 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:20:23 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:owner>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:user uuid="61fabd845c2a4368bab99d4ca469452a">tempest-ServerActionsTestOtherA-1563000763-project-member</nova:user>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:project uuid="5c2a93601bf545c7b13b34afc2c0da24">tempest-ServerActionsTestOtherA-1563000763</nova:project>
Nov 30 09:20:23 user nova-compute[75340]:       </nova:owner>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:20:23 user nova-compute[75340]:       <nova:ports>
Nov 30 09:20:23 user nova-compute[75340]:         <nova:port uuid="738e3ea5-c7f7-4353-8a1f-a5c9115cb244">
Nov 30 09:20:23 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:20:23 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:23 user nova-compute[75340]:       </nova:ports>
Nov 30 09:20:23 user nova-compute[75340]:     </nova:instance>
Nov 30 09:20:23 user nova-compute[75340]:   </metadata>
Nov 30 09:20:23 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:20:23 user nova-compute[75340]:     <system>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="serial">9455558a-7e24-449d-a515-436c818bf5c4</entry>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="uuid">9455558a-7e24-449d-a515-436c818bf5c4</entry>
Nov 30 09:20:23 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:20:23 user nova-compute[75340]:     </system>
Nov 30 09:20:23 user nova-compute[75340]:   </sysinfo>
Nov 30 09:20:23 user nova-compute[75340]:   <os>
Nov 30 09:20:23 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:20:23 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:20:23 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:20:23 user nova-compute[75340]:   </os>
Nov 30 09:20:23 user nova-compute[75340]:   <features>
Nov 30 09:20:23 user nova-compute[75340]:     <acpi/>
Nov 30 09:20:23 user nova-compute[75340]:     <apic/>
Nov 30 09:20:23 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:20:23 user nova-compute[75340]:   </features>
Nov 30 09:20:23 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:20:23 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:20:23 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:20:23 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:20:23 user nova-compute[75340]:   </clock>
Nov 30 09:20:23 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:20:23 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:20:23 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:20:23 user nova-compute[75340]:   </cpu>
Nov 30 09:20:23 user nova-compute[75340]:   <devices>
Nov 30 09:20:23 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:20:23 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:20:23 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk"/>
Nov 30 09:20:23 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:20:23 user nova-compute[75340]:     </disk>
Nov 30 09:20:23 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:20:23 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:20:23 user nova-compute[75340]:       <source dev="/dev/sdj"/>
Nov 30 09:20:23 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:20:23 user nova-compute[75340]:       <serial>a5b125b8-d57c-4de9-89ea-0a0d34a387d2</serial>
Nov 30 09:20:23 user nova-compute[75340]:     </disk>
Nov 30 09:20:23 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:23 user nova-compute[75340]:       <mac address="fa:16:3e:06:c9:68"/>
Nov 30 09:20:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:23 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:23 user nova-compute[75340]:       <target dev="tap738e3ea5-c7"/>
Nov 30 09:20:23 user nova-compute[75340]:     </interface>
Nov 30 09:20:23 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:20:23 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/console.log" append="off"/>
Nov 30 09:20:23 user nova-compute[75340]:     </serial>
Nov 30 09:20:23 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:20:23 user nova-compute[75340]:     <video>
Nov 30 09:20:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:23 user nova-compute[75340]:     </video>
Nov 30 09:20:23 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:20:23 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:20:23 user nova-compute[75340]:     </rng>
Nov 30 09:20:23 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:20:23 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:20:23 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:20:23 user nova-compute[75340]:     </memballoon>
Nov 30 09:20:23 user nova-compute[75340]:   </devices>
Nov 30 09:20:23 user nova-compute[75340]: </domain>
Nov 30 09:20:23 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-ServerActionsTestOtherA-server-1218651476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG os_vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac1f94f5-b2c0-55a5-86c6-214de1e114eb', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738e3ea5-c7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap738e3ea5-c7, col_values=(('qos', UUID('81ce79d9-58b2-4bea-8580-4463df80b323')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap738e3ea5-c7, col_values=(('external_ids', {'iface-id': '738e3ea5-c7f7-4353-8a1f-a5c9115cb244', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:c9:68', 'vm-uuid': '9455558a-7e24-449d-a515-436c818bf5c4'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:23 user nova-compute[75340]: INFO os_vif [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7')
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:06:c9:68, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:24 user nova-compute[75340]: WARNING nova.compute.manager [req-58d512f6-008d-41de-835c-cdbef9397669 req-ddd14944-3ff7-4bf4-80fd-1dfa41974cca service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state active and task_state rescuing.
Nov 30 09:20:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-239fbccd-c2f4-46c1-a655-9135f10382d3 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:26 user nova-compute[75340]: WARNING nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 09:20:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:26 user nova-compute[75340]: WARNING nova.compute.manager [req-408f43db-a83c-4c28-bad3-9290fb35297a req-c20b23c9-84a9-43c8-a2b5-92ddc5ec83d4 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:20:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance spawned successfully.
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75340) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7628c4cb-dd28-4c49-8825-cbd1dcac17db tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:29 user nova-compute[75340]: INFO nova.compute.manager [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Unrescuing
Nov 30 09:20:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:20:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:20:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.objects.instance [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'flavor' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:20:30 user nova-compute[75340]: INFO nova.compute.claims [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Claim successful on node user
Nov 30 09:20:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:30 user nova-compute[75340]: WARNING nova.compute.manager [req-99fc6e48-c4f3-490e-8805-f30489a44b64 req-c829e034-b95d-4c8b-80e1-60e8502e9dac service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:20:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:30 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 is timed out.
Nov 30 09:20:31 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully detached device vdc from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the live domain config.
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBLTSmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:20:31 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4bde8-8cb9-452b-aac1-f46d2fa43967]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:20:31 user nova-compute[75340]: No targets found.
Nov 30 09:20:31 user nova-compute[75340]: iSNS:
Nov 30 09:20:31 user nova-compute[75340]: No targets found.
Nov 30 09:20:31 user nova-compute[75340]: STATIC:
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:20:31 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:20:31 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:20:31 user nova-compute[75340]: FIRMWARE:
Nov 30 09:20:31 user nova-compute[75340]: No targets found.
Nov 30 09:20:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:20:31 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:20:31 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance destroyed successfully.
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[684691e7-94a5-4ad4-9867-bda33d9b26e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464a6c2-24a1-439e-9a11-3585ba61c7d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:20:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50125900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb'): ({'sdg'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Removing single pathed devices sdg {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ec159-3109-461b-bd8d-2af84cd4f92d]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e467ee7-b7dc-4da0-9c45-b75916ab8f95]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Flushing IO for device /dev/sdg {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.895s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf6d51-5b00-4c0a-8d8c-6bb48a20690d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3f189c-f8ea-479e-a724-b08934d35cc3]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a1576-e527-4a2a-92c7-922d908b5d86]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca8562-7132-454f-81e4-acc63bd5bca3]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260]
Nov 30 09:20:31 user nova-compute[75340]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb, portal: 172.16.0.220,3260] successful.
Nov 30 09:20:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.policy [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea3a2d5bc1c47ea988021ed23683f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddb2f89853f41d08fbeb37811d9d4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4cabfc-5867-4e87-a643-2f5e2de95ecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.079s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d3366-6ee2-4544-a5e3-ce9e9bebcbf2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.541s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== disconnect_volume: return (543ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:20:31 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Creating image(s)
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "/opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.223s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.253s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk 1073741824" returned: 0 in 0.079s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Successfully created port: e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Cannot resize image /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:32 user nova-compute[75340]: WARNING nova.compute.manager [req-eed22457-bdfb-4446-89d2-379eb88c0faa req-56a43a69-b1d0-4a2f-a5cc-c9cabacf3781 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:20:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3da6d639-a6db-4805-8114-889fc1b59c11 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.665s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Successfully updated port: e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquired lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:20:33 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating instance_info_cache with network_info: [{"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Releasing lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Instance network_info: |[{"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Start _get_guest_xml network_info=[{"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:20:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:34 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:34 user nova-compute[75340]: WARNING nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 240c7075-56a8-437b-9b07-cfa7914f10ed {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 342c9729-6990-4f95-8d1e-6c3ba45a881c {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 21360976-bd14-407a-82f3-7543a1f052b3 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid c6ff93f6-b93f-4898-a587-9c74b3002b8f {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 2cba226e-fba2-424f-8be1-82700df03360 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 279b49b7-6b6f-4d14-bc3a-ae18849bf122 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "21360976-bd14-407a-82f3-7543a1f052b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: INFO nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "2cba226e-fba2-424f-8be1-82700df03360" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.162s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.216s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.213s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.229s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185126405',display_name='tempest-AttachVolumeNegativeTest-server-1185126405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185126405',id=24,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FBWVmJX3+4Y0DsXMdg5f83/IejTm/X9IRGKq2/A/0rSd2fqgaPhryIZEK2uaqyh82cjclfNsQbEaT7r9f/K7ILAPuEU6niP9Dd4cQNrAoAb7GYLbkV/4IK0EV2Suxgw==',key_name='tempest-keypair-2142834208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-uk1e7m3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=33cc4d61-c9d2-420b-87a5-6b9fe188a7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'pci_devices' on Instance uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.301s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.303s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "2cba226e-fba2-424f-8be1-82700df03360" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.306s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.306s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "21360976-bd14-407a-82f3-7543a1f052b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.314s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.309s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:20:34 user nova-compute[75340]:   <uuid>33cc4d61-c9d2-420b-87a5-6b9fe188a7b8</uuid>
Nov 30 09:20:34 user nova-compute[75340]:   <name>instance-00000018</name>
Nov 30 09:20:34 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:20:34 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:20:34 user nova-compute[75340]:   <metadata>
Nov 30 09:20:34 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:20:34 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1185126405</nova:name>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:20:34</nova:creationTime>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:20:34 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:20:34 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:owner>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:user uuid="fea3a2d5bc1c47ea988021ed23683f08">tempest-AttachVolumeNegativeTest-689840258-project-member</nova:user>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:project uuid="4ddb2f89853f41d08fbeb37811d9d4e8">tempest-AttachVolumeNegativeTest-689840258</nova:project>
Nov 30 09:20:34 user nova-compute[75340]:       </nova:owner>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:20:34 user nova-compute[75340]:       <nova:ports>
Nov 30 09:20:34 user nova-compute[75340]:         <nova:port uuid="e248fc69-202d-471a-945b-1c109ca11f4b">
Nov 30 09:20:34 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:20:34 user nova-compute[75340]:         </nova:port>
Nov 30 09:20:34 user nova-compute[75340]:       </nova:ports>
Nov 30 09:20:34 user nova-compute[75340]:     </nova:instance>
Nov 30 09:20:34 user nova-compute[75340]:   </metadata>
Nov 30 09:20:34 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:20:34 user nova-compute[75340]:     <system>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="serial">33cc4d61-c9d2-420b-87a5-6b9fe188a7b8</entry>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="uuid">33cc4d61-c9d2-420b-87a5-6b9fe188a7b8</entry>
Nov 30 09:20:34 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:20:34 user nova-compute[75340]:     </system>
Nov 30 09:20:34 user nova-compute[75340]:   </sysinfo>
Nov 30 09:20:34 user nova-compute[75340]:   <os>
Nov 30 09:20:34 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:20:34 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:20:34 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:20:34 user nova-compute[75340]:   </os>
Nov 30 09:20:34 user nova-compute[75340]:   <features>
Nov 30 09:20:34 user nova-compute[75340]:     <acpi/>
Nov 30 09:20:34 user nova-compute[75340]:     <apic/>
Nov 30 09:20:34 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:20:34 user nova-compute[75340]:   </features>
Nov 30 09:20:34 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:20:34 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:20:34 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:20:34 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:20:34 user nova-compute[75340]:   </clock>
Nov 30 09:20:34 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:20:34 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:20:34 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:20:34 user nova-compute[75340]:   </cpu>
Nov 30 09:20:34 user nova-compute[75340]:   <devices>
Nov 30 09:20:34 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:20:34 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:20:34 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk"/>
Nov 30 09:20:34 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:20:34 user nova-compute[75340]:     </disk>
Nov 30 09:20:34 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:20:34 user nova-compute[75340]:       <mac address="fa:16:3e:87:c6:a1"/>
Nov 30 09:20:34 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:34 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:20:34 user nova-compute[75340]:       <target dev="tape248fc69-20"/>
Nov 30 09:20:34 user nova-compute[75340]:     </interface>
Nov 30 09:20:34 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:20:34 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/console.log" append="off"/>
Nov 30 09:20:34 user nova-compute[75340]:     </serial>
Nov 30 09:20:34 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:20:34 user nova-compute[75340]:     <video>
Nov 30 09:20:34 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:20:34 user nova-compute[75340]:     </video>
Nov 30 09:20:34 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:20:34 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:20:34 user nova-compute[75340]:     </rng>
Nov 30 09:20:34 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:20:34 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:20:34 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:20:34 user nova-compute[75340]:     </memballoon>
Nov 30 09:20:34 user nova-compute[75340]:   </devices>
Nov 30 09:20:34 user nova-compute[75340]: </domain>
Nov 30 09:20:34 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185126405',display_name='tempest-AttachVolumeNegativeTest-server-1185126405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185126405',id=24,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FBWVmJX3+4Y0DsXMdg5f83/IejTm/X9IRGKq2/A/0rSd2fqgaPhryIZEK2uaqyh82cjclfNsQbEaT7r9f/K7ILAPuEU6niP9Dd4cQNrAoAb7GYLbkV/4IK0EV2Suxgw==',key_name='tempest-keypair-2142834208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-uk1e7m3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=33cc4d61-c9d2-420b-87a5-6b9fe188a7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG os_vif [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38560de3-554c-5955-a7d8-be998d0f1f5a', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.403s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape248fc69-20, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape248fc69-20, col_values=(('qos', UUID('38ea1048-8977-4127-a32b-29ea0f22ac11')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape248fc69-20, col_values=(('external_ids', {'iface-id': 'e248fc69-202d-471a-945b-1c109ca11f4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:c6:a1', 'vm-uuid': '33cc4d61-c9d2-420b-87a5-6b9fe188a7b8'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:34 user nova-compute[75340]: INFO os_vif [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20')
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:34 user nova-compute[75340]: WARNING nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-changed-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Refreshing instance network info cache due to event network-changed-e248fc69-202d-471a-945b-1c109ca11f4b. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Acquiring lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Acquired lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.network.neutron [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Refreshing network info cache for port e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:20:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:87:c6:a1, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updated VIF entry in instance network info cache for port e248fc69-202d-471a-945b-1c109ca11f4b. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating instance_info_cache with network_info: [{"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Releasing lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:35 user nova-compute[75340]: WARNING nova.compute.manager [req-26121fcc-3f9c-4f1f-be8e-1938e569d5a4 req-f822ee55-2474-464a-b105-2f33acba1846 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:20:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-88cb32ae-2f6a-4325-b6cc-84d1f36dbcea tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:20:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] No waiting events found dispatching network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:37 user nova-compute[75340]: WARNING nova.compute.manager [req-1cc235b7-87bf-4f76-9863-dde01bad1ff6 req-8362bec1-db01-4c91-9f32-5b9cfed86632 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received unexpected event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b for instance with vm_state building and task_state spawning.
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] No waiting events found dispatching network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:39 user nova-compute[75340]: WARNING nova.compute.manager [req-b8d20b73-fb46-432b-a535-aeab5feee401 req-4f8394b4-60db-497c-8dd0-d1718bae47e9 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received unexpected event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b for instance with vm_state building and task_state spawning.
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:20:39 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Instance spawned successfully.
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:39 user nova-compute[75340]: INFO nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Took 8.13 seconds to spawn the instance on the hypervisor.
Nov 30 09:20:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:20:39 user nova-compute[75340]: INFO nova.compute.manager [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Took 9.63 seconds to build instance.
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1e1fbbb5-df91-4c0e-976b-fb1971ef809a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.837s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.732s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:39 user nova-compute[75340]: INFO nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 30 09:20:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:43 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:43 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:20:43 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7070MB free_disk=25.411651611328125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c6ff93f6-b93f-4898-a587-9c74b3002b8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2cba226e-fba2-424f-8be1-82700df03360 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:44 user nova-compute[75340]: INFO nova.compute.manager [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Terminating instance
Nov 30 09:20:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-unplugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] No waiting events found dispatching network-vif-unplugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-f762f829-025e-43d4-af53-099ca8a0e10b req-7ea83c9b-f08b-4360-b0bc-d4688172b9c3 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-unplugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:20:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Instance destroyed successfully.
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.objects.instance [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lazy-loading 'resources' on Instance uuid c6ff93f6-b93f-4898-a587-9c74b3002b8f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1524401047',display_name='tempest-VolumesActionsTest-instance-1524401047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1524401047',id=21,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30c13e39440043da8ad17279e7f77ba5',ramdisk_id='',reservation_id='r-z6png81w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1601763647',owner_user_name='tempest-VolumesActionsTest-1601763647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:18:55Z,user_data=None,user_id='28e1f2386a5048c48131d6d1ef0550bf',uuid=c6ff93f6-b93f-4898-a587-9c74b3002b8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converting VIF {"id": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "address": "fa:16:3e:cf:f2:75", "network": {"id": "46e46811-690f-484d-a0a7-780eff865f20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1547619094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30c13e39440043da8ad17279e7f77ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21391617-23", "ovs_interfaceid": "21391617-2354-4e59-a3e6-ac4e041ce0b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG os_vif [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21391617-23, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb97f867-4bf9-4c21-995c-5756290cc46d) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:20:45 user nova-compute[75340]: INFO os_vif [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f2:75,bridge_name='br-int',has_traffic_filtering=True,id=21391617-2354-4e59-a3e6-ac4e041ce0b3,network=Network(46e46811-690f-484d-a0a7-780eff865f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21391617-23')
Nov 30 09:20:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Deleting instance files /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f_del
Nov 30 09:20:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Deletion of /opt/stack/data/nova/instances/c6ff93f6-b93f-4898-a587-9c74b3002b8f_del complete
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:20:45 user nova-compute[75340]: INFO nova.compute.manager [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 30 09:20:45 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:20:45 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c75cfeb4-0aed-436d-b774-c7a8d980e593 req-1726b22e-bc0d-4845-bfc7-21c42871384a service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-deleted-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:46 user nova-compute[75340]: INFO nova.compute.manager [req-c75cfeb4-0aed-436d-b774-c7a8d980e593 req-1726b22e-bc0d-4845-bfc7-21c42871384a service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Neutron deleted interface 21391617-2354-4e59-a3e6-ac4e041ce0b3; detaching it from the instance and deleting it from the info cache
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.network.neutron [req-c75cfeb4-0aed-436d-b774-c7a8d980e593 req-1726b22e-bc0d-4845-bfc7-21c42871384a service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:20:46 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Took 0.65 seconds to deallocate network for instance.
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c75cfeb4-0aed-436d-b774-c7a8d980e593 req-1726b22e-bc0d-4845-bfc7-21c42871384a service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Detach interface failed, port_id=21391617-2354-4e59-a3e6-ac4e041ce0b3, reason: Instance c6ff93f6-b93f-4898-a587-9c74b3002b8f could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:20:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:46 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Deleted allocations for instance c6ff93f6-b93f-4898-a587-9c74b3002b8f
Nov 30 09:20:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-209a4066-4805-4251-81c9-556de2dba08f tempest-VolumesActionsTest-1601763647 tempest-VolumesActionsTest-1601763647-project-member] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:20:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] Acquiring lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:20:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:20:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] Lock "c6ff93f6-b93f-4898-a587-9c74b3002b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:20:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] No waiting events found dispatching network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:20:47 user nova-compute[75340]: WARNING nova.compute.manager [req-9d1eb039-1d36-488d-ab5c-838bb79df2e2 req-2a7367a8-3c2a-4f10-ab92-bd920e2b98f5 service nova] [instance: c6ff93f6-b93f-4898-a587-9c74b3002b8f] Received unexpected event network-vif-plugged-21391617-2354-4e59-a3e6-ac4e041ce0b3 for instance with vm_state deleted and task_state None.
Nov 30 09:20:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:20:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:00 user nova-compute[75340]: INFO nova.compute.manager [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Detaching volume 415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:21:00 user nova-compute[75340]: INFO nova.virt.block_device [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Attempting to driver detach volume 415a56d6-6871-4721-bc9c-b7b66b290a2a from mountpoint /dev/vdb
Nov 30 09:21:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Attempting to detach device vdb from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:21:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:21:00 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:21:00 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:21:00 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:21:00 user nova-compute[75340]:   <serial>415a56d6-6871-4721-bc9c-b7b66b290a2a</serial>
Nov 30 09:21:00 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:21:00 user nova-compute[75340]: </disk>
Nov 30 09:21:00 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:21:00 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully detached device vdb from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the persistent domain config.
Nov 30 09:21:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:21:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:21:00 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:21:00 user nova-compute[75340]:   <source dev="/dev/sde"/>
Nov 30 09:21:00 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:21:00 user nova-compute[75340]:   <serial>415a56d6-6871-4721-bc9c-b7b66b290a2a</serial>
Nov 30 09:21:00 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:21:00 user nova-compute[75340]: </disk>
Nov 30 09:21:00 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:21:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:21:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-changed-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Refreshing instance network info cache due to event network-changed-7f89c78c-5bf5-4138-858a-01076110bea6. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:21:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] Acquiring lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:21:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] Acquired lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:21:11 user nova-compute[75340]: DEBUG nova.network.neutron [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Refreshing network info cache for port 7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:21:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updated VIF entry in instance network info cache for port 7f89c78c-5bf5-4138-858a-01076110bea6. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:21:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating instance_info_cache with network_info: [{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6147373d-ed1d-41df-8403-a1c7e6fc2cd1 req-396dec1f-fd00-46af-ac74-b7bbd2f96539 service nova] Releasing lock "refresh_cache-279b49b7-6b6f-4d14-bc3a-ae18849bf122" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:21:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:12 user nova-compute[75340]: INFO nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Rebuilding instance
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:13 user nova-compute[75340]: WARNING nova.compute.manager [req-e7de327d-a6b1-43d8-9b85-40778de7d13e req-589b2314-dae0-4e06-9dee-a87e7859516e service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state active and task_state rebuilding.
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance destroyed successfully.
Nov 30 09:21:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance destroyed successfully.
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641542013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f89c78c-5b, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d227cb21-faca-4895-8977-9fd2b613717d) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:13 user nova-compute[75340]: INFO os_vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b')
Nov 30 09:21:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:13 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa41b44-b726-4b5e-b936-c872f675200d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:13 user nova-compute[75340]: No targets found.
Nov 30 09:21:13 user nova-compute[75340]: iSNS:
Nov 30 09:21:13 user nova-compute[75340]: No targets found.
Nov 30 09:21:13 user nova-compute[75340]: STATIC:
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:13 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:13 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:13 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:13 user nova-compute[75340]: No targets found.
Nov 30 09:21:13 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:13 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:13 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3778f6-43dd-486d-827d-eadeef506bf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5381d1-81e4-4cf6-b08a-d951d57649c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff3068b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da714c-859b-4d94-b94c-6934a488a1a1]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b74f8-8c03-460f-a26d-138a92373f18]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30ad98c-d7cb-4fad-a674-35f32555d4f2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[54027e58-0e45-4ef8-a5cd-7638ad409991]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26265333530383531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1775d10', '/dev/disk/by-id/scsi-1SCST_BIOe1775d10-be35085129df4e17') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5e1b4-ec81-4e4f-914e-be6150b259d4]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a100bc6c-cf59-4339-a0ee-9b13de0ed668]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f2a010-6f68-4e22-8e53-c27ef2ee8ff2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]
Nov 30 09:21:14 user nova-compute[75340]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e32280-5453-4e55-b61c-72ddb9f75237]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== disconnect_volume: return (417ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deleting instance files /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122_del
Nov 30 09:21:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deletion of /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122_del complete
Nov 30 09:21:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 could not be found.
Nov 30 09:21:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7063f7f9-6a32-45d9-9434-452a3d45590a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:14 user nova-compute[75340]: No targets found.
Nov 30 09:21:14 user nova-compute[75340]: iSNS:
Nov 30 09:21:14 user nova-compute[75340]: No targets found.
Nov 30 09:21:14 user nova-compute[75340]: STATIC:
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:14 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:14 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:14 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:14 user nova-compute[75340]: No targets found.
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:14 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:14 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca198bc7-7ca8-41ee-a716-30634b759271]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ca218-37bc-4b3e-973d-629569cdece9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5044c4c0>, {}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Disconnecting from: [] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== disconnect_volume: return (91ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:15 user nova-compute[75340]: WARNING nova.compute.manager [req-b6c8a9cb-7157-4e52-b9cc-ab7ab207551b req-e41a1273-3327-4e8f-b5da-5b62d4694fea service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state active and task_state rebuilding.
Nov 30 09:21:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Preparing to wait for external event volume-reimaged-dd197763-bcf4-4069-95c4-a818fa2dfa73 {{(pid=75340) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:21:16 user nova-compute[75340]: INFO nova.compute.claims [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Claim successful on node user
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:21:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.policy [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d13c8d8c984172a828f34deb3f9bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca9314cdc634dfa9df097fcd53c2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:21:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Creating image(s)
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Successfully created port: c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Cannot resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Ensure instance console log exists: /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Successfully updated port: c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-changed-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Refreshing instance network info cache due to event network-changed-c57b695b-790c-46f8-acab-abc09cccf781. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance network_info: |[{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Refreshing network info cache for port c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start _get_guest_xml network_info=[{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:21:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:21:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:21:18 user nova-compute[75340]:   <uuid>9c6c4ed4-4acc-4a24-bf80-820a72587045</uuid>
Nov 30 09:21:18 user nova-compute[75340]:   <name>instance-00000019</name>
Nov 30 09:21:18 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:21:18 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:21:18 user nova-compute[75340]:   <metadata>
Nov 30 09:21:18 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:21:18 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeTestJSON-server-1854362006</nova:name>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:21:18</nova:creationTime>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:21:18 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:21:18 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:owner>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:user uuid="82d13c8d8c984172a828f34deb3f9bf6">tempest-AttachVolumeTestJSON-158840588-project-member</nova:user>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:project uuid="cca9314cdc634dfa9df097fcd53c2c2c">tempest-AttachVolumeTestJSON-158840588</nova:project>
Nov 30 09:21:18 user nova-compute[75340]:       </nova:owner>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:21:18 user nova-compute[75340]:       <nova:ports>
Nov 30 09:21:18 user nova-compute[75340]:         <nova:port uuid="c57b695b-790c-46f8-acab-abc09cccf781">
Nov 30 09:21:18 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:21:18 user nova-compute[75340]:         </nova:port>
Nov 30 09:21:18 user nova-compute[75340]:       </nova:ports>
Nov 30 09:21:18 user nova-compute[75340]:     </nova:instance>
Nov 30 09:21:18 user nova-compute[75340]:   </metadata>
Nov 30 09:21:18 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:21:18 user nova-compute[75340]:     <system>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="serial">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="uuid">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:21:18 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:21:18 user nova-compute[75340]:     </system>
Nov 30 09:21:18 user nova-compute[75340]:   </sysinfo>
Nov 30 09:21:18 user nova-compute[75340]:   <os>
Nov 30 09:21:18 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:21:18 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:21:18 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:21:18 user nova-compute[75340]:   </os>
Nov 30 09:21:18 user nova-compute[75340]:   <features>
Nov 30 09:21:18 user nova-compute[75340]:     <acpi/>
Nov 30 09:21:18 user nova-compute[75340]:     <apic/>
Nov 30 09:21:18 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:21:18 user nova-compute[75340]:   </features>
Nov 30 09:21:18 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:21:18 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:21:18 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:21:18 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:21:18 user nova-compute[75340]:   </clock>
Nov 30 09:21:18 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:21:18 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:21:18 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:21:18 user nova-compute[75340]:   </cpu>
Nov 30 09:21:18 user nova-compute[75340]:   <devices>
Nov 30 09:21:18 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:21:18 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:21:18 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk"/>
Nov 30 09:21:18 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:21:18 user nova-compute[75340]:     </disk>
Nov 30 09:21:18 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:21:18 user nova-compute[75340]:       <mac address="fa:16:3e:d4:c0:a7"/>
Nov 30 09:21:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:21:18 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:21:18 user nova-compute[75340]:       <target dev="tapc57b695b-79"/>
Nov 30 09:21:18 user nova-compute[75340]:     </interface>
Nov 30 09:21:18 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:21:18 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/console.log" append="off"/>
Nov 30 09:21:18 user nova-compute[75340]:     </serial>
Nov 30 09:21:18 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:21:18 user nova-compute[75340]:     <video>
Nov 30 09:21:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:21:18 user nova-compute[75340]:     </video>
Nov 30 09:21:18 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:21:18 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:21:18 user nova-compute[75340]:     </rng>
Nov 30 09:21:18 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:21:18 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:21:18 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:21:18 user nova-compute[75340]:     </memballoon>
Nov 30 09:21:18 user nova-compute[75340]:   </devices>
Nov 30 09:21:18 user nova-compute[75340]: </domain>
Nov 30 09:21:18 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG os_vif [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50fb9c37-fed0-51b1-97e6-b829e26da570', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc57b695b-79, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc57b695b-79, col_values=(('qos', UUID('bb2ca52a-cd44-4ce8-bd39-d7b09437fd55')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc57b695b-79, col_values=(('external_ids', {'iface-id': 'c57b695b-790c-46f8-acab-abc09cccf781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c0:a7', 'vm-uuid': '9c6c4ed4-4acc-4a24-bf80-820a72587045'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:18 user nova-compute[75340]: INFO os_vif [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No VIF found with MAC fa:16:3e:d4:c0:a7, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updated VIF entry in instance network info cache for port c57b695b-790c-46f8-acab-abc09cccf781. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ef5570f9-bb7f-4e7d-a352-826256f29d62 req-805353a8-43cb-4b47-8335-3b63f40441ed service nova] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:21:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:20 user nova-compute[75340]: WARNING nova.compute.manager [req-809adc54-f46e-411c-b8cb-d69a8cca63f3 req-50e785e6-25aa-429b-a581-0d8b33ddcf71 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state building and task_state spawning.
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 is timed out.
Nov 30 09:21:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully detached device vdb from instance 2c5351f7-c57f-4b35-8642-3a124259bef7 from the live domain config.
Nov 30 09:21:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYgzuvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74d495-6cb8-4a1d-8b05-4e4ba6aae8bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:21 user nova-compute[75340]: No targets found.
Nov 30 09:21:21 user nova-compute[75340]: iSNS:
Nov 30 09:21:21 user nova-compute[75340]: No targets found.
Nov 30 09:21:21 user nova-compute[75340]: STATIC:
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:21 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:21 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:21 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:21 user nova-compute[75340]: No targets found.
Nov 30 09:21:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:21 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:21 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9492bbb-4ba1-4301-9514-2ba15f328f3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fad402-6119-4db5-9283-e9fc1f184cf2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:21 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307b1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a'): ({'sde'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Removing single pathed devices sde {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca32be-1e43-4175-a8bc-2fbb74b8864c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b28c11-ee05-44d4-bffd-cf60fabf59bf]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Flushing IO for device /dev/sde {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d67c0-4159-4b63-858b-eaafb392d2b8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8c723-7668-4ed1-a9ab-3e95f8eaa0f2]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e152af0-dc53-4aff-9b6e-6271ee7000f4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df36193-e649-433f-a534-77b78e9d7048]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260]
Nov 30 09:21:21 user nova-compute[75340]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a, portal: 172.16.0.220,3260] successful.
Nov 30 09:21:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:415a56d6-6871-4721-bc9c-b7b66b290a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa90e9-0705-4719-9c39-2da937660095]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] <== disconnect_volume: return (348ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:21:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance spawned successfully.
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:22 user nova-compute[75340]: WARNING nova.compute.manager [req-188c0825-7f8e-4bab-810b-56743d29620d req-ad4a83ac-a1d4-481d-a923-4ab1207bacce service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state building and task_state spawning.
Nov 30 09:21:22 user nova-compute[75340]: INFO nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 30 09:21:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:21:22 user nova-compute[75340]: INFO nova.compute.manager [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Took 6.46 seconds to build instance.
Nov 30 09:21:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f069303d-f99b-4764-a673-54c7aba62a40 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.568s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'flavor' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:21:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e3e8b970-3063-42c5-bfb8-dd4559d51641 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.562s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:21:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:21:36 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 240c7075-56a8-437b-9b07-cfa7914f10ed {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:21:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updating instance_info_cache with network_info: [{"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-240c7075-56a8-437b-9b07-cfa7914f10ed" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:21:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:21:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:38 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:38 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:39 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-20427acc-ca1a-42c1-af67-1ae543ae6f75 req-f27f3f10-0ce1-4cee-a76d-ec9027666657 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event volume-reimaged-dd197763-bcf4-4069-95c4-a818fa2dfa73 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-20427acc-ca1a-42c1-af67-1ae543ae6f75 req-f27f3f10-0ce1-4cee-a76d-ec9027666657 service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-20427acc-ca1a-42c1-af67-1ae543ae6f75 req-f27f3f10-0ce1-4cee-a76d-ec9027666657 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-20427acc-ca1a-42c1-af67-1ae543ae6f75 req-f27f3f10-0ce1-4cee-a76d-ec9027666657 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-20427acc-ca1a-42c1-af67-1ae543ae6f75 req-f27f3f10-0ce1-4cee-a76d-ec9027666657 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Processing event volume-reimaged-dd197763-bcf4-4069-95c4-a818fa2dfa73 {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:21:40 user nova-compute[75340]: INFO nova.virt.block_device [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Booting with volume dd197763-bcf4-4069-95c4-a818fa2dfa73 at /dev/vda
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.utils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75a358-12f5-4d8a-8dee-dfdad8ae77ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad9642-8a6a-4597-8f6b-466228706e89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e4fae-2267-45f0-b92f-f0da98c9cef7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[49115b44-b9c5-4488-8950-8f7930f70158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:21:40 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d067c27d-1383-40b3-842b-b5746fd401cd]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG os_brick.utils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating existing volume attachment record: 5b70e62b-339a-45e1-9c93-d60541b4387e {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:21:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:21:44 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=6970MB free_disk=25.343685150146484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 240c7075-56a8-437b-9b07-cfa7914f10ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance cd3f40a8-6a0f-4116-b654-e222153dd2a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 2cba226e-fba2-424f-8be1-82700df03360 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:21:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:21:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:51 user nova-compute[75340]: INFO nova.compute.manager [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Terminating instance
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-unplugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] No waiting events found dispatching network-vif-unplugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-3a4dc2ea-e9e5-4c3c-9b30-d872e85f1661 req-f60995a7-4d96-4987-808b-00c1af93df34 service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-unplugged-4b66c617-632c-4a02-9820-6af836ca78ab for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Instance destroyed successfully.
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lazy-loading 'resources' on Instance uuid 2c5351f7-c57f-4b35-8642-3a124259bef7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1786363411',display_name='tempest-TestServerVolumeAttachmentScenario-server-1786363411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1786363411',id=17,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqSJAPEVChQEFg+gKCu8zHhkUH/WAzWIBKFxEg0wr4jshjAyiYxdc5/kQnDQKd8rCeXSxc64fWSpYxD0uBAV5UYtQPu8cdGu0p8u9d4kc2SOKA84UPAZb00tuiINvdjw==',key_name='tempest-keypair-497003295',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8038735fb054b7594ecc999f8a1bd1b',ramdisk_id='',reservation_id='r-z5hlp821',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444957444',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444957444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f498547afe8147f8b449af9ed8e88977',uuid=2c5351f7-c57f-4b35-8642-3a124259bef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converting VIF {"id": "4b66c617-632c-4a02-9820-6af836ca78ab", "address": "fa:16:3e:0c:2f:e4", "network": {"id": "bf15a383-abb1-4f8f-89c6-59527de6a514", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-24892993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8038735fb054b7594ecc999f8a1bd1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66c617-63", "ovs_interfaceid": "4b66c617-632c-4a02-9820-6af836ca78ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG os_vif [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b66c617-63, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=036d159c-8828-4fc7-96f7-0e9a7b8f908f) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:51 user nova-compute[75340]: INFO os_vif [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4b66c617-632c-4a02-9820-6af836ca78ab,network=Network(bf15a383-abb1-4f8f-89c6-59527de6a514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66c617-63')
Nov 30 09:21:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Deleting instance files /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7_del
Nov 30 09:21:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Deletion of /opt/stack/data/nova/instances/2c5351f7-c57f-4b35-8642-3a124259bef7_del complete
Nov 30 09:21:52 user nova-compute[75340]: INFO nova.compute.manager [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 09:21:52 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:52 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Took 0.92 seconds to deallocate network for instance.
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-7fcb82c6-e681-4160-b20c-11c7587923cc req-534f1592-f00d-4891-862f-5c85abb6175c service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-deleted-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:52 user nova-compute[75340]: INFO nova.compute.manager [req-7fcb82c6-e681-4160-b20c-11c7587923cc req-534f1592-f00d-4891-862f-5c85abb6175c service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Neutron deleted interface 4b66c617-632c-4a02-9820-6af836ca78ab; detaching it from the instance and deleting it from the info cache
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-7fcb82c6-e681-4160-b20c-11c7587923cc req-534f1592-f00d-4891-862f-5c85abb6175c service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-7fcb82c6-e681-4160-b20c-11c7587923cc req-534f1592-f00d-4891-862f-5c85abb6175c service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Detach interface failed, port_id=4b66c617-632c-4a02-9820-6af836ca78ab, reason: Instance 2c5351f7-c57f-4b35-8642-3a124259bef7 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] Acquiring lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] No waiting events found dispatching network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:53 user nova-compute[75340]: WARNING nova.compute.manager [req-eb38a8a0-813c-498a-a6d1-bf3445468e9c req-df558a7f-d2be-4f47-a1a3-cf58b770545e service nova] [instance: 2c5351f7-c57f-4b35-8642-3a124259bef7] Received unexpected event network-vif-plugged-4b66c617-632c-4a02-9820-6af836ca78ab for instance with vm_state deleted and task_state None.
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:53 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Deleted allocations for instance 2c5351f7-c57f-4b35-8642-3a124259bef7
Nov 30 09:21:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e65299da-629c-458c-aeec-49c2c74628e4 tempest-TestServerVolumeAttachmentScenario-444957444 tempest-TestServerVolumeAttachmentScenario-444957444-project-member] Lock "2c5351f7-c57f-4b35-8642-3a124259bef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-changed-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing instance network info cache due to event network-changed-f8013651-1781-4640-ab51-752ffb484494. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] Acquiring lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] Acquired lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG nova.network.neutron [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Refreshing network info cache for port f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG nova.network.neutron [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updated VIF entry in instance network info cache for port f8013651-1781-4640-ab51-752ffb484494. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG nova.network.neutron [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:21:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8bca11fa-ac24-4bf5-ae91-6d6581f8fce4 req-54dc84c1-6479-4bca-b2ab-adfc8c69e80f service nova] Releasing lock "refresh_cache-2cba226e-fba2-424f-8be1-82700df03360" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:56 user nova-compute[75340]: INFO nova.compute.manager [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Terminating instance
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-b57ac42d-e26f-42c3-9b86-f670f3ab474d req-09d7772b-f23a-4512-9661-bbec6d502cd1 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-852297e3-9240-407e-b53b-d5e45cd80f87 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-625c8132-1a16-4c3e-b279-6c9bf7eac818 req-ba048202-156b-454e-9c0c-e00aeb91bca7 service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-f8013651-1781-4640-ab51-752ffb484494 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:57 user nova-compute[75340]: WARNING nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-f8013651-1781-4640-ab51-752ffb484494 for instance with vm_state active and task_state deleting.
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:57 user nova-compute[75340]: WARNING nova.compute.manager [req-660c8224-e7a0-4de3-9a17-f83f0e89d501 req-2e0ea21e-3aba-45e4-bc93-561c0d373fdb service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6 for instance with vm_state active and task_state deleting.
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Instance destroyed successfully.
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lazy-loading 'resources' on Instance uuid 2cba226e-fba2-424f-8be1-82700df03360 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8013651-17, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ecb2ee5-a621-492f-b334-4dde8dff0958) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=f8013651-1781-4640-ab51-752ffb484494,network=Network(53a38872-b830-465d-944a-ecf0b0730efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8013651-17')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap852297e3-92, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5723eda5-2357-4018-b435-b14e1d517e19) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:de:f8,bridge_name='br-int',has_traffic_filtering=True,id=852297e3-9240-407e-b53b-d5e45cd80f87,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap852297e3-92')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdde7a901-d0, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5714a5bf-c9fd-499d-92f6-f1bcfc0bb4a5) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:64,bridge_name='br-int',has_traffic_filtering=True,id=dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdde7a901-d0')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d4f3e2-52, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=282eca7f-1446-42b9-8470-4a9f42a7f2fe) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6c:05,bridge_name='br-int',has_traffic_filtering=True,id=c3d4f3e2-52a0-4af7-96ac-cc442a708403,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d4f3e2-52')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped449386-4c, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc5bc971-761a-4d45-80fd-2b47b64bfcdc) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3c:73,bridge_name='br-int',has_traffic_filtering=True,id=ed449386-4cd7-4e58-aee3-c2318e4f55ca,network=Network(c017e1a5-59be-45c4-8a7d-13ab41802d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped449386-4c')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "address": "fa:16:3e:21:7b:c4", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb87c456-e7", "ovs_interfaceid": "db87c456-e7c1-4344-91fe-c6f5d61cf22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb87c456-e7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f385c7ee-8107-4d5d-a5b2-db8fa60a6b02) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:7b:c4,bridge_name='br-int',has_traffic_filtering=True,id=db87c456-e7c1-4344-91fe-c6f5d61cf22d,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb87c456-e7')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T09:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1647921727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1647921727',id=22,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInUTZOrq8Hq6MQMDNzaTHP0yAxDV6GjTXpioAUEMCPseYzqyrqSi4rKm3v0Vs4UEiK1WzOhjFhLp8SKO5gYIAjjhOzKN3taPDU9UNAFIHTjfLTjsj720Dd64JhqT1ATGw==',key_name='tempest-keypair-812688593',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e48df89a5f4191baf8803d1fce4543',ramdisk_id='',reservation_id='r-tojclz46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-841004651',owner_user_name='tempest-TaggedBootDevicesTest_v242-841004651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0df98d618a24eeaa3177dbfa0c34b10',uuid=2cba226e-fba2-424f-8be1-82700df03360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converting VIF {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38c38183-8c, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fee12f6-7f9e-421a-a415-f8ee11d9e28c) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: INFO os_vif [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:96:d2,bridge_name='br-int',has_traffic_filtering=True,id=38c38183-8c09-4e61-ba91-a2bbda235541,network=Network(7e4b675a-a62b-4715-bc54-c86deaf847ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c38183-8c')
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZpoSzaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:58 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5a4ed-6cf2-447d-91fa-6076592b9b5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]: iSNS:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]: STATIC:
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:58 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:58 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff505b-37fc-4dcc-9dbc-240571b14070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15751817-244f-4ded-9dac-a054ff356287]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:58 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:58 user nova-compute[75340]: WARNING nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-852297e3-9240-407e-b53b-d5e45cd80f87 for instance with vm_state active and task_state deleting.
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:58 user nova-compute[75340]: WARNING nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-db87c456-e7c1-4344-91fe-c6f5d61cf22d for instance with vm_state active and task_state deleting.
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-38c38183-8c09-4e61-ba91-a2bbda235541 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:58 user nova-compute[75340]: WARNING nova.compute.manager [req-4b2a2c71-5231-4d5b-a86f-487eff82b80b req-abdd7a69-cbef-42a5-974b-a660999b6e0e service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-38c38183-8c09-4e61-ba91-a2bbda235541 for instance with vm_state active and task_state deleting.
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f33124-8bc7-4824-ab69-b493c537ab65]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff9a73-a6c3-40ae-8d87-96f9c5520784]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f4fde-4ceb-4cc5-8815-93b8b545b597]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cea018-161f-4317-a2dd-c6aa4b5190e4]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.064s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a2262-d051-439a-b5b2-fc28601e16ee]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f2c54-8d47-41ed-bb28-cdf6e2115154]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260]
Nov 30 09:21:58 user nova-compute[75340]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb, portal: 172.16.0.220,3260] successful.
Nov 30 09:21:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7254610-c0e8-489a-9969-d0600d8c1acb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748faf7-9d77-4a07-b38e-e3f86b16f966]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== disconnect_volume: return (364ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxWhVkdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:58 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ba1b0-1c74-4637-aa66-ba8c0a62b99b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]: iSNS:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]: STATIC:
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:58 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:58 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:58 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:58 user nova-compute[75340]: No targets found.
Nov 30 09:21:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:58 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:58 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c4122-6df6-40ec-b930-cf8d8ebdcdd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa407bc6-8c3d-49cd-8f1b-2cc4254ce417]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31057c-691f-438c-b4db-f08b5dd78f72]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7795f637-b1c7-47cb-9f32-899b071397f3]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[647454ae-3a35-4d36-9649-9d1fb7b36879]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70094d59-f73a-4d55-bd97-0b3d993b4553]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b6c9d5-bb87-4761-b9d1-efb04065ac6d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[034083e1-4967-4020-8022-c0dd2e4e9d7d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260]
Nov 30 09:21:59 user nova-compute[75340]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c, portal: 172.16.0.220,3260] successful.
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23bf61d5-c83d-46d3-b268-ba003594e97c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56dc78-a4d5-470a-85f3-d44130af9e72]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== disconnect_volume: return (346ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNOtveVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:21:59 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:59 user nova-compute[75340]: WARNING nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-c3d4f3e2-52a0-4af7-96ac-cc442a708403 for instance with vm_state active and task_state deleting.
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-unplugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-unplugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Acquiring lock "2cba226e-fba2-424f-8be1-82700df03360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] Lock "2cba226e-fba2-424f-8be1-82700df03360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] No waiting events found dispatching network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:21:59 user nova-compute[75340]: WARNING nova.compute.manager [req-04457219-8a2f-4f6c-aa75-d41c99eb249c req-b2be74b5-d96c-459c-a08c-402d4e2d18bf service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received unexpected event network-vif-plugged-ed449386-4cd7-4e58-aee3-c2318e4f55ca for instance with vm_state active and task_state deleting.
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3487fa36-d258-40dc-b72e-02631f69f11c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:21:59 user nova-compute[75340]: No targets found.
Nov 30 09:21:59 user nova-compute[75340]: iSNS:
Nov 30 09:21:59 user nova-compute[75340]: No targets found.
Nov 30 09:21:59 user nova-compute[75340]: STATIC:
Nov 30 09:21:59 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:21:59 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:59 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:59 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:21:59 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:59 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:59 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0
Nov 30 09:21:59 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:59 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:59 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:21:59 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:21:59 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:21:59 user nova-compute[75340]: FIRMWARE:
Nov 30 09:21:59 user nova-compute[75340]: No targets found.
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:21:59 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:21:59 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f09fd72-7bf7-4fdc-b051-bff79fc93f68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4de0c3-96c1-43da-8617-b11415b8d618]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50126200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0'): ({'sdi'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Removing single pathed devices sdi {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd7f113-4514-4b1e-96ee-9e5a94d403ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d2beeb-f436-43d3-9065-3c873a2a3f07]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Flushing IO for device /dev/sdi {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c14dd8f-ca0c-4ec3-a33f-b2075d2fe435]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec1ec4-f212-4dfd-8eb1-7341159d0fe2]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] SCSI volumes sdi have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[166955ca-2973-4049-a456-711fb31c0d32]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db31f87-b441-4867-b0b5-9d34aea787b7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260]
Nov 30 09:21:59 user nova-compute[75340]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0, portal: 172.16.0.220,3260] successful.
Nov 30 09:21:59 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e03a247-308d-40a2-8620-e351bed8e1d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1642def-07fe-4860-a3fa-e50567414d8e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] <== disconnect_volume: return (337ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:21:59 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Deleting instance files /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360_del
Nov 30 09:21:59 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Deletion of /opt/stack/data/nova/instances/2cba226e-fba2-424f-8be1-82700df03360_del complete
Nov 30 09:21:59 user nova-compute[75340]: INFO nova.compute.manager [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Took 3.60 seconds to destroy the instance on the hypervisor.
Nov 30 09:21:59 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:21:59 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:22:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-c2f2833c-10dc-4eef-8875-afebbb0ca253 req-5f921937-b62e-4183-adf0-2d9ebfbd790f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-deleted-db87c456-e7c1-4344-91fe-c6f5d61cf22d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:01 user nova-compute[75340]: INFO nova.compute.manager [req-c2f2833c-10dc-4eef-8875-afebbb0ca253 req-5f921937-b62e-4183-adf0-2d9ebfbd790f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Neutron deleted interface db87c456-e7c1-4344-91fe-c6f5d61cf22d; detaching it from the instance and deleting it from the info cache
Nov 30 09:22:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-c2f2833c-10dc-4eef-8875-afebbb0ca253 req-5f921937-b62e-4183-adf0-2d9ebfbd790f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [{"id": "f8013651-1781-4640-ab51-752ffb484494", "address": "fa:16:3e:db:fb:55", "network": {"id": "53a38872-b830-465d-944a-ecf0b0730efa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1086427801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8013651-17", "ovs_interfaceid": "f8013651-1781-4640-ab51-752ffb484494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852297e3-9240-407e-b53b-d5e45cd80f87", "address": "fa:16:3e:85:de:f8", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852297e3-92", "ovs_interfaceid": "852297e3-9240-407e-b53b-d5e45cd80f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "address": "fa:16:3e:aa:aa:64", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde7a901-d0", "ovs_interfaceid": "dde7a901-d0dd-4a72-8cd6-b0dd42ad1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "address": "fa:16:3e:93:6c:05", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d4f3e2-52", "ovs_interfaceid": "c3d4f3e2-52a0-4af7-96ac-cc442a708403", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "address": "fa:16:3e:f3:3c:73", "network": {"id": "c017e1a5-59be-45c4-8a7d-13ab41802d0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2145587058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped449386-4c", "ovs_interfaceid": "ed449386-4cd7-4e58-aee3-c2318e4f55ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38c38183-8c09-4e61-ba91-a2bbda235541", "address": "fa:16:3e:15:96:d2", "network": {"id": "7e4b675a-a62b-4715-bc54-c86deaf847ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-872656785", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3e48df89a5f4191baf8803d1fce4543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c38183-8c", "ovs_interfaceid": "38c38183-8c09-4e61-ba91-a2bbda235541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-c2f2833c-10dc-4eef-8875-afebbb0ca253 req-5f921937-b62e-4183-adf0-2d9ebfbd790f service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Detach interface failed, port_id=db87c456-e7c1-4344-91fe-c6f5d61cf22d, reason: Instance 2cba226e-fba2-424f-8be1-82700df03360 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:22:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:03 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:03 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Took 4.25 seconds to deallocate network for instance.
Nov 30 09:22:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-f717cb4b-4add-4e13-8374-c4eb0fd6e3f4 req-e8b67c22-114b-4e62-8e9a-c3060ab6105a service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-deleted-ed449386-4cd7-4e58-aee3-c2318e4f55ca {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-f717cb4b-4add-4e13-8374-c4eb0fd6e3f4 req-e8b67c22-114b-4e62-8e9a-c3060ab6105a service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-deleted-c3d4f3e2-52a0-4af7-96ac-cc442a708403 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-f717cb4b-4add-4e13-8374-c4eb0fd6e3f4 req-e8b67c22-114b-4e62-8e9a-c3060ab6105a service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-deleted-38c38183-8c09-4e61-ba91-a2bbda235541 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-f717cb4b-4add-4e13-8374-c4eb0fd6e3f4 req-e8b67c22-114b-4e62-8e9a-c3060ab6105a service nova] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Received event network-vif-deleted-f8013651-1781-4640-ab51-752ffb484494 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:22:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Creating image(s)
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Ensure instance console log exists: /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start _get_guest_xml network_info=[{"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '5b70e62b-339a-45e1-9c93-d60541b4387e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '279b49b7-6b6f-4d14-bc3a-ae18849bf122', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd197763-bcf4-4069-95c4-a818fa2dfa73', 'serial': 'dd197763-bcf4-4069-95c4-a818fa2dfa73'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:22:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 09:22:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lazy-loading 'vcpu_model' on Instance uuid 279b49b7-6b6f-4d14-bc3a-ae18849bf122 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:22:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:22:06 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:22:06 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174d1db-f028-48d9-b309-99c4966125b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:22:06 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d595108-3981-4414-b40d-a74b3cd6b58d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73] added
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e4935-17de-4265-84a1-90f9de8ab2af]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8cdf09-d77f-47d4-b063-877b8c118b3a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtcqsMKu {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtcqsMKu" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d968604-43ea-41ac-a493-8a1a03067642]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtcqsMKu'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e531962-6f25-4f00-ae05-48f3bbafa293]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b06047-15f5-4d4c-ac8e-da5f0483053c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --login" returned: 0 in 0.138s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[890dd21c-3f2e-4fa9-82f2-c8d75c667239]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]
Nov 30 09:22:06 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd74dc-cf64-4d77-9866-d134dbdcc882]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[457fd34e-5a06-415f-bf76-712699f02f0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:06 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0376c0d7-e81d-4899-ab14-e8c1de8cf415]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:22:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26265333530383531', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265333530383531', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641542013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:22:07 user nova-compute[75340]:   <uuid>279b49b7-6b6f-4d14-bc3a-ae18849bf122</uuid>
Nov 30 09:22:07 user nova-compute[75340]:   <name>instance-00000017</name>
Nov 30 09:22:07 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:22:07 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:22:07 user nova-compute[75340]:   <metadata>
Nov 30 09:22:07 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:22:07 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:22:07 user nova-compute[75340]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1641542013</nova:name>
Nov 30 09:22:07 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:22:06</nova:creationTime>
Nov 30 09:22:07 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:22:07 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:22:07 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:22:07 user nova-compute[75340]:       <nova:owner>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:user uuid="5a28287fd9aa4e5fb60248a68fc79836">tempest-ServerActionsV293TestJSON-755520446-project-member</nova:user>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:project uuid="24dc7cb1fbef4211bc357a83142f9ae2">tempest-ServerActionsV293TestJSON-755520446</nova:project>
Nov 30 09:22:07 user nova-compute[75340]:       </nova:owner>
Nov 30 09:22:07 user nova-compute[75340]:       <nova:ports>
Nov 30 09:22:07 user nova-compute[75340]:         <nova:port uuid="7f89c78c-5bf5-4138-858a-01076110bea6">
Nov 30 09:22:07 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:22:07 user nova-compute[75340]:         </nova:port>
Nov 30 09:22:07 user nova-compute[75340]:       </nova:ports>
Nov 30 09:22:07 user nova-compute[75340]:     </nova:instance>
Nov 30 09:22:07 user nova-compute[75340]:   </metadata>
Nov 30 09:22:07 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:22:07 user nova-compute[75340]:     <system>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="serial">279b49b7-6b6f-4d14-bc3a-ae18849bf122</entry>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="uuid">279b49b7-6b6f-4d14-bc3a-ae18849bf122</entry>
Nov 30 09:22:07 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:22:07 user nova-compute[75340]:     </system>
Nov 30 09:22:07 user nova-compute[75340]:   </sysinfo>
Nov 30 09:22:07 user nova-compute[75340]:   <os>
Nov 30 09:22:07 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:22:07 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:22:07 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:22:07 user nova-compute[75340]:   </os>
Nov 30 09:22:07 user nova-compute[75340]:   <features>
Nov 30 09:22:07 user nova-compute[75340]:     <acpi/>
Nov 30 09:22:07 user nova-compute[75340]:     <apic/>
Nov 30 09:22:07 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:22:07 user nova-compute[75340]:   </features>
Nov 30 09:22:07 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:22:07 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:22:07 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:22:07 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:22:07 user nova-compute[75340]:   </clock>
Nov 30 09:22:07 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:22:07 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:22:07 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:22:07 user nova-compute[75340]:   </cpu>
Nov 30 09:22:07 user nova-compute[75340]:   <devices>
Nov 30 09:22:07 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:22:07 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:07 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:22:07 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:22:07 user nova-compute[75340]:       <serial>dd197763-bcf4-4069-95c4-a818fa2dfa73</serial>
Nov 30 09:22:07 user nova-compute[75340]:     </disk>
Nov 30 09:22:07 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:22:07 user nova-compute[75340]:       <mac address="fa:16:3e:e9:78:31"/>
Nov 30 09:22:07 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:22:07 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:22:07 user nova-compute[75340]:       <target dev="tap7f89c78c-5b"/>
Nov 30 09:22:07 user nova-compute[75340]:     </interface>
Nov 30 09:22:07 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:22:07 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122/console.log" append="off"/>
Nov 30 09:22:07 user nova-compute[75340]:     </serial>
Nov 30 09:22:07 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:22:07 user nova-compute[75340]:     <video>
Nov 30 09:22:07 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:22:07 user nova-compute[75340]:     </video>
Nov 30 09:22:07 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:22:07 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:22:07 user nova-compute[75340]:     </rng>
Nov 30 09:22:07 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:22:07 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:22:07 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:22:07 user nova-compute[75340]:     </memballoon>
Nov 30 09:22:07 user nova-compute[75340]:   </devices>
Nov 30 09:22:07 user nova-compute[75340]: </domain>
Nov 30 09:22:07 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641542013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG os_vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb7f67b5-824f-5474-8876-4c48c7c78224', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f89c78c-5b, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f89c78c-5b, col_values=(('qos', UUID('1a8f9931-20a7-483e-9c36-3e1215648e34')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f89c78c-5b, col_values=(('external_ids', {'iface-id': '7f89c78c-5bf5-4138-858a-01076110bea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:78:31', 'vm-uuid': '279b49b7-6b6f-4d14-bc3a-ae18849bf122'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:07 user nova-compute[75340]: INFO os_vif [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b')
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:22:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] No VIF found with MAC fa:16:3e:e9:78:31, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:22:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:09 user nova-compute[75340]: WARNING nova.compute.manager [req-1780fc0a-a204-4e60-b1bc-44d2883b9fd9 req-811c6458-d304-412a-b402-1366ab4b9e8b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 09:22:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:22:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance spawned successfully.
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:11 user nova-compute[75340]: WARNING nova.compute.manager [req-8000e8df-6de8-41e6-b026-3f8f9c68e705 req-b337d653-8c22-49e5-8fbe-8e32a47bdc57 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG nova.objects.instance [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75340) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 09:22:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20427acc-ca1a-42c1-af67-1ae543ae6f75 tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:15 user nova-compute[75340]: INFO nova.compute.manager [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] [instance: 2cba226e-fba2-424f-8be1-82700df03360] Took 11.73 seconds to detach 3 volumes for instance.
Nov 30 09:22:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:16 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:22:16 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:22:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:16 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Deleted allocations for instance 2cba226e-fba2-424f-8be1-82700df03360
Nov 30 09:22:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4c9e38cd-e68a-47af-a26e-c47e3376854c tempest-TaggedBootDevicesTest_v242-841004651 tempest-TaggedBootDevicesTest_v242-841004651-project-member] Lock "2cba226e-fba2-424f-8be1-82700df03360" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.270s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-changed-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Refreshing instance network info cache due to event network-changed-e248fc69-202d-471a-945b-1c109ca11f4b. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] Acquiring lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] Acquired lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Refreshing network info cache for port e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updated VIF entry in instance network info cache for port e248fc69-202d-471a-945b-1c109ca11f4b. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating instance_info_cache with network_info: [{"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-14aaa1e1-5abd-47bd-b576-11f4d8564d8e req-0c340756-1f23-4bae-9061-8ac119636d01 service nova] Releasing lock "refresh_cache-33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:22:22 user nova-compute[75340]: INFO nova.compute.claims [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Claim successful on node user
Nov 30 09:22:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:22:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.policy [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14f79ef5cc314a3bb971a811a317a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9daa1b03684fb6b29fa66f0f355e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:22:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Creating image(s)
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "/opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.239s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.210s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk 1073741824" returned: 0 in 0.052s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Successfully created port: 57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.249s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Cannot resize image /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Ensure instance console log exists: /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Successfully updated port: 57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received event network-changed-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Refreshing instance network info cache due to event network-changed-57822f08-e975-4788-83f2-e45e06d673e1. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] Acquiring lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:22:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Updating instance_info_cache with network_info: [{"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Instance network_info: |[{"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] Acquired lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Refreshing network info cache for port 57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Start _get_guest_xml network_info=[{"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:22:25 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:22:25 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-847229174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-847229174',id=26,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-m60v8397',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:22:23Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=978db29e-9a39-4638-ab8a-470768ccb4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 978db29e-9a39-4638-ab8a-470768ccb4b2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:22:25 user nova-compute[75340]:   <uuid>978db29e-9a39-4638-ab8a-470768ccb4b2</uuid>
Nov 30 09:22:25 user nova-compute[75340]:   <name>instance-0000001a</name>
Nov 30 09:22:25 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:22:25 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:22:25 user nova-compute[75340]:   <metadata>
Nov 30 09:22:25 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:22:25 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-847229174</nova:name>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:22:25</nova:creationTime>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:22:25 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:22:25 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:owner>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:22:25 user nova-compute[75340]:       </nova:owner>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:22:25 user nova-compute[75340]:       <nova:ports>
Nov 30 09:22:25 user nova-compute[75340]:         <nova:port uuid="57822f08-e975-4788-83f2-e45e06d673e1">
Nov 30 09:22:25 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 09:22:25 user nova-compute[75340]:         </nova:port>
Nov 30 09:22:25 user nova-compute[75340]:       </nova:ports>
Nov 30 09:22:25 user nova-compute[75340]:     </nova:instance>
Nov 30 09:22:25 user nova-compute[75340]:   </metadata>
Nov 30 09:22:25 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:22:25 user nova-compute[75340]:     <system>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="serial">978db29e-9a39-4638-ab8a-470768ccb4b2</entry>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="uuid">978db29e-9a39-4638-ab8a-470768ccb4b2</entry>
Nov 30 09:22:25 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:22:25 user nova-compute[75340]:     </system>
Nov 30 09:22:25 user nova-compute[75340]:   </sysinfo>
Nov 30 09:22:25 user nova-compute[75340]:   <os>
Nov 30 09:22:25 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:22:25 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:22:25 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:22:25 user nova-compute[75340]:   </os>
Nov 30 09:22:25 user nova-compute[75340]:   <features>
Nov 30 09:22:25 user nova-compute[75340]:     <acpi/>
Nov 30 09:22:25 user nova-compute[75340]:     <apic/>
Nov 30 09:22:25 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:22:25 user nova-compute[75340]:   </features>
Nov 30 09:22:25 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:22:25 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:22:25 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:22:25 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:22:25 user nova-compute[75340]:   </clock>
Nov 30 09:22:25 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:22:25 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:22:25 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:22:25 user nova-compute[75340]:   </cpu>
Nov 30 09:22:25 user nova-compute[75340]:   <devices>
Nov 30 09:22:25 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:22:25 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:22:25 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk"/>
Nov 30 09:22:25 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:22:25 user nova-compute[75340]:     </disk>
Nov 30 09:22:25 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:22:25 user nova-compute[75340]:       <mac address="fa:16:3e:c3:64:c3"/>
Nov 30 09:22:25 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:22:25 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:22:25 user nova-compute[75340]:       <target dev="tap57822f08-e9"/>
Nov 30 09:22:25 user nova-compute[75340]:     </interface>
Nov 30 09:22:25 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:22:25 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/console.log" append="off"/>
Nov 30 09:22:25 user nova-compute[75340]:     </serial>
Nov 30 09:22:25 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:22:25 user nova-compute[75340]:     <video>
Nov 30 09:22:25 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:22:25 user nova-compute[75340]:     </video>
Nov 30 09:22:25 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:22:25 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:22:25 user nova-compute[75340]:     </rng>
Nov 30 09:22:25 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:22:25 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:22:25 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:22:25 user nova-compute[75340]:     </memballoon>
Nov 30 09:22:25 user nova-compute[75340]:   </devices>
Nov 30 09:22:25 user nova-compute[75340]: </domain>
Nov 30 09:22:25 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-847229174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-847229174',id=26,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-m60v8397',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:22:23Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=978db29e-9a39-4638-ab8a-470768ccb4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_vif [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29d758b4-4645-56de-a390-9b772b158e60', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57822f08-e9, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57822f08-e9, col_values=(('qos', UUID('77ad3a46-3cba-4d94-828c-a6a2031fb798')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57822f08-e9, col_values=(('external_ids', {'iface-id': '57822f08-e975-4788-83f2-e45e06d673e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:64:c3', 'vm-uuid': '978db29e-9a39-4638-ab8a-470768ccb4b2'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:25 user nova-compute[75340]: INFO os_vif [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9')
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:c3:64:c3, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:25 user nova-compute[75340]: INFO nova.compute.manager [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Attaching volume 4d8ac3b7-b93a-48dd-a76f-312535a08409 to /dev/vdb
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Updated VIF entry in instance network info cache for port 57822f08-e975-4788-83f2-e45e06d673e1. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Updating instance_info_cache with network_info: [{"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9c910639-6253-479d-8675-120a9710f10c req-7f588089-68cc-4e34-a30b-978943867055 service nova] Releasing lock "refresh_cache-978db29e-9a39-4638-ab8a-470768ccb4b2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.utils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0e64e-6c57-4c4a-b825-8e1d2fdde09e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0ecab-3453-40b5-97eb-6a5ec1310e69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6ab72-1e0c-4969-9f2b-3c05c95626a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd26ba40-d67e-4806-8f85-9ba27644dfdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:22:25 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:22:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b69c42-cb7e-48bf-a57d-407d1798c627]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG os_brick.utils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:22:25 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating existing volume attachment record: 3e024a3d-34cb-4c98-8931-2a6a673d87b2 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] No waiting events found dispatching network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:26 user nova-compute[75340]: WARNING nova.compute.manager [req-41883397-1e5f-4609-a89a-499718cef326 req-3d322301-789d-4c4d-8782-f30c2ffa61d8 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received unexpected event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 for instance with vm_state building and task_state spawning.
Nov 30 09:22:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:22:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:22:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Instance spawned successfully.
Nov 30 09:22:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] No waiting events found dispatching network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:29 user nova-compute[75340]: WARNING nova.compute.manager [req-549a284f-14f5-4e09-a0b1-cecb93fe7729 req-777906e9-8c7e-4c32-827c-155069dd4881 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received unexpected event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 for instance with vm_state building and task_state spawning.
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:22:29 user nova-compute[75340]: INFO nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 30 09:22:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:22:29 user nova-compute[75340]: INFO nova.compute.manager [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Took 6.86 seconds to build instance.
Nov 30 09:22:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-79fd9ba1-34d7-4d49-88bc-7af27b1234a6 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.050s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:31 user nova-compute[75340]: INFO nova.compute.manager [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Terminating instance
Nov 30 09:22:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-b9f17638-cefe-4de3-a90e-7929c5854fa2 req-2620e6f0-9ac5-42ab-a692-38e97aad6d04 service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-unplugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:32 user nova-compute[75340]: INFO nova.compute.manager [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Terminating instance
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Instance destroyed successfully.
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lazy-loading 'resources' on Instance uuid cd3f40a8-6a0f-4116-b654-e222153dd2a4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1737055794',display_name='tempest-ServerActionsTestOtherB-server-1737055794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1737055794',id=5,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/0YbPJpCIFIrERYmktHyEzvhrCYPr6TrB0auiYZzEqUvG0zpPPWMhvfQBRELl6jmTXr8xWjavUToLZlC4OlvMUNErQDJDBSYfjJKTqduuUplvcCQ2YOx+sy08UBL4WMQ==',key_name='tempest-keypair-1113797362',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='082add99abc342f9aa296b611fd4cb85',ramdisk_id='',reservation_id='r-xo9iautd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-642872739',owner_user_name='tempest-ServerActionsTestOtherB-642872739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeac2f0e248940b1b494f96c8e7535d5',uuid=cd3f40a8-6a0f-4116-b654-e222153dd2a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converting VIF {"id": "4948b73b-dc7f-4720-8006-1232706b4aac", "address": "fa:16:3e:f5:c0:76", "network": {"id": "946effb1-a8c4-49dd-b1b7-eddae48d75d2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-849881350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "082add99abc342f9aa296b611fd4cb85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4948b73b-dc", "ovs_interfaceid": "4948b73b-dc7f-4720-8006-1232706b4aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_vif [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4948b73b-dc, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a097f60-58c3-4bf9-a90e-b47592b766e2) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: INFO os_vif [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:76,bridge_name='br-int',has_traffic_filtering=True,id=4948b73b-dc7f-4720-8006-1232706b4aac,network=Network(946effb1-a8c4-49dd-b1b7-eddae48d75d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4948b73b-dc')
Nov 30 09:22:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StPFBMKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:22:32 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5649ad-4e8e-49de-823d-587a00bdfa41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:22:32 user nova-compute[75340]: No targets found.
Nov 30 09:22:32 user nova-compute[75340]: iSNS:
Nov 30 09:22:32 user nova-compute[75340]: No targets found.
Nov 30 09:22:32 user nova-compute[75340]: STATIC:
Nov 30 09:22:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:22:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:22:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:22:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:22:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:22:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:22:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf
Nov 30 09:22:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:22:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:22:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:22:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:22:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:22:32 user nova-compute[75340]: FIRMWARE:
Nov 30 09:22:32 user nova-compute[75340]: No targets found.
Nov 30 09:22:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:22:32 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:22:32 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ecb09-2c18-4e94-904d-0f33c3923385]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3e695-fdc5-4cf8-82ee-978aa5639e79]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:32 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305a2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf'): ({'sdh'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Removing single pathed devices sdh {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43a48c-418b-4a04-a63c-da3cbc192a2d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[48809cf4-5daf-446a-936c-7186718d97f6]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Flushing IO for device /dev/sdh {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a91aa3-c460-499b-829a-3ba9e7b7b987]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abacac-ced7-407e-9778-9ecd5ba0e569]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] SCSI volumes sdh have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e85425-af15-47fa-8115-1f45e3759874]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Instance destroyed successfully.
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lazy-loading 'resources' on Instance uuid 240c7075-56a8-437b-9b07-cfa7914f10ed {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d3f66-4118-438c-971d-5a1d7b4328c4]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260]
Nov 30 09:22:33 user nova-compute[75340]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf, portal: 172.16.0.220,3260] successful.
Nov 30 09:22:33 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317548186',display_name='tempest-ServersNegativeTestJSON-server-317548186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317548186',id=1,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8863798b8e9b48309a3c365ff2ea40f4',ramdisk_id='',reservation_id='r-1we88dfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1523211864',owner_user_name='tempest-ServersNegativeTestJSON-1523211864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:13:53Z,user_data=None,user_id='44ea0b017210427eb36856893f55725e',uuid=240c7075-56a8-437b-9b07-cfa7914f10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converting VIF {"id": "055dc2bb-d01e-45b7-9869-285be0996f52", "address": "fa:16:3e:9c:2c:72", "network": {"id": "8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274235459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8863798b8e9b48309a3c365ff2ea40f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055dc2bb-d0", "ovs_interfaceid": "055dc2bb-d01e-45b7-9869-285be0996f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG os_vif [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap055dc2bb-d0, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd4dbce-d836-491d-9109-cf96338dbcaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980dc0d-49af-4506-81fb-95d9de2c4ca7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2b95304-a372-4225-9ba0-9479dfae5b4e) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] <== disconnect_volume: return (410ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Deleting instance files /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_del
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Deletion of /opt/stack/data/nova/instances/cd3f40a8-6a0f-4116-b654-e222153dd2a4_del complete
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:22:33 user nova-compute[75340]: INFO os_vif [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=055dc2bb-d01e-45b7-9869-285be0996f52,network=Network(8e45f345-bb9e-4fa7-8dc5-dd48c11a10e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055dc2bb-d0')
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Deleting instance files /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed_del
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Deletion of /opt/stack/data/nova/instances/240c7075-56a8-437b-9b07-cfa7914f10ed_del complete
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.compute.manager [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:22:33 user nova-compute[75340]: INFO nova.compute.manager [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 30 09:22:33 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:33 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:34 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Took 0.88 seconds to deallocate network for instance.
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-51cf0a37-5570-4233-b683-deb7e562cb37 req-755dc335-a80a-45e6-a8aa-05766993005c service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-deleted-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Acquiring lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] No waiting events found dispatching network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:34 user nova-compute[75340]: WARNING nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Received unexpected event network-vif-plugged-4948b73b-dc7f-4720-8006-1232706b4aac for instance with vm_state active and task_state deleting.
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-unplugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] No waiting events found dispatching network-vif-unplugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-unplugged-055dc2bb-d01e-45b7-9869-285be0996f52 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Acquiring lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] No waiting events found dispatching network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:22:34 user nova-compute[75340]: WARNING nova.compute.manager [req-6b68aba1-e540-46e1-99f1-6e74e335fa1f req-8c709193-f6af-4111-8efc-65eb6ae9847c service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received unexpected event network-vif-plugged-055dc2bb-d01e-45b7-9869-285be0996f52 for instance with vm_state active and task_state deleting.
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:34 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Took 1.34 seconds to deallocate network for instance.
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:22:34 user nova-compute[75340]: INFO nova.compute.manager [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] [instance: cd3f40a8-6a0f-4116-b654-e222153dd2a4] Took 0.89 seconds to detach 1 volumes for instance.
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:22:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.036s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:35 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Deleted allocations for instance 240c7075-56a8-437b-9b07-cfa7914f10ed
Nov 30 09:22:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e6060eb8-c3b1-4ecf-9e64-56939c3b5469 tempest-ServersNegativeTestJSON-1523211864 tempest-ServersNegativeTestJSON-1523211864-project-member] Lock "240c7075-56a8-437b-9b07-cfa7914f10ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.995s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:35 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Deleted allocations for instance cd3f40a8-6a0f-4116-b654-e222153dd2a4
Nov 30 09:22:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d939f07d-9ada-4a0f-b497-710b0c2d0f0c tempest-ServerActionsTestOtherB-642872739 tempest-ServerActionsTestOtherB-642872739-project-member] Lock "cd3f40a8-6a0f-4116-b654-e222153dd2a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.127s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-e1c8f59d-ae03-47eb-bf7f-ec9c28963e90 req-10fd56db-3cd2-42f2-96a2-bf2b3b432489 service nova] [instance: 240c7075-56a8-437b-9b07-cfa7914f10ed] Received event network-vif-deleted-055dc2bb-d01e-45b7-9869-285be0996f52 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:22:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:22:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:22:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:22:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:38 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scIWiCeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:22:39 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:22:39 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:22:39 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9dedf-d2ce-4b83-910b-7d4ea5fd2b37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:22:39 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[383219de-f86b-4057-9401-ed4f57a21b86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409] added
Nov 30 09:22:39 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b413672-04d8-4ada-89cf-9d799b84e1d4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c31ef3e-de1e-4ca1-8990-5840f598fef1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scIWiCeJ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scIWiCeJ" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44a071-4f52-4f73-aa49-c55f1ba56dda]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scIWiCeJ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccfafe-b4b1-4510-bb46-a6d0307a2177]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6f6df-4090-4169-845d-a46a5c5602d6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[df556d6a-7516-43fa-98c9-e9409027edb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260]
Nov 30 09:22:40 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260] successful.
Nov 30 09:22:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc0c2a-9ced-4125-a2d6-f9cb5fb4206e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0aa46b-d824-4464-8cf6-73729e611b73]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)
Nov 30 09:22:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d0427-e39b-4793-8e5c-e34c3a7260fc]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scIWiCeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23333366462313838', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333366462313838', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.objects.instance [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:22:41 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:41 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:22:41 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:22:41 user nova-compute[75340]:   <serial>4d8ac3b7-b93a-48dd-a76f-312535a08409</serial>
Nov 30 09:22:41 user nova-compute[75340]: </disk>
Nov 30 09:22:41 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:87:c6:a1, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:22:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-58a3a1b5-ee20-48ea-8951-204234804bed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.498s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:43 user nova-compute[75340]: INFO nova.compute.manager [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Detaching volume 4d8ac3b7-b93a-48dd-a76f-312535a08409
Nov 30 09:22:43 user nova-compute[75340]: INFO nova.virt.block_device [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Attempting to driver detach volume 4d8ac3b7-b93a-48dd-a76f-312535a08409 from mountpoint /dev/vdb
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Attempting to detach device vdb from instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:22:43 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:43 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:22:43 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:22:43 user nova-compute[75340]:   <serial>4d8ac3b7-b93a-48dd-a76f-312535a08409</serial>
Nov 30 09:22:43 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:22:43 user nova-compute[75340]: </disk>
Nov 30 09:22:43 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:22:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 from the persistent domain config.
Nov 30 09:22:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:22:43 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:43 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:22:43 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:22:43 user nova-compute[75340]:   <serial>4d8ac3b7-b93a-48dd-a76f-312535a08409</serial>
Nov 30 09:22:43 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:22:43 user nova-compute[75340]: </disk>
Nov 30 09:22:43 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:22:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:22:46 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:22:46 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.411457061767578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9455558a-7e24-449d-a515-436c818bf5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:22:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:22:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:22:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:22:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:22:55 user nova-compute[75340]: INFO nova.compute.manager [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Detaching volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:22:55 user nova-compute[75340]: INFO nova.virt.block_device [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Attempting to driver detach volume a5b125b8-d57c-4de9-89ea-0a0d34a387d2 from mountpoint /dev/vdb
Nov 30 09:22:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Attempting to detach device vdb from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:22:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:22:55 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:55 user nova-compute[75340]:   <source dev="/dev/sdj"/>
Nov 30 09:22:55 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:22:55 user nova-compute[75340]:   <serial>a5b125b8-d57c-4de9-89ea-0a0d34a387d2</serial>
Nov 30 09:22:55 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:22:55 user nova-compute[75340]: </disk>
Nov 30 09:22:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:22:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully detached device vdb from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the persistent domain config.
Nov 30 09:22:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:22:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:22:55 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:22:55 user nova-compute[75340]:   <source dev="/dev/sdj"/>
Nov 30 09:22:55 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:22:55 user nova-compute[75340]:   <serial>a5b125b8-d57c-4de9-89ea-0a0d34a387d2</serial>
Nov 30 09:22:55 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:22:55 user nova-compute[75340]: </disk>
Nov 30 09:22:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:22:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:22:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:22:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 is timed out.
Nov 30 09:23:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 from the live domain config.
Nov 30 09:23:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scIWiCeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:23:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2101bb-2d57-4ad7-9089-14738f3d8f3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:23:04 user nova-compute[75340]: No targets found.
Nov 30 09:23:04 user nova-compute[75340]: iSNS:
Nov 30 09:23:04 user nova-compute[75340]: No targets found.
Nov 30 09:23:04 user nova-compute[75340]: STATIC:
Nov 30 09:23:04 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:23:04 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:04 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:04 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:23:04 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:04 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:04 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:23:04 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:04 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:04 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409
Nov 30 09:23:04 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:04 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:04 user nova-compute[75340]: FIRMWARE:
Nov 30 09:23:04 user nova-compute[75340]: No targets found.
Nov 30 09:23:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:23:04 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:23:04 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a2159c-a36a-44e4-ab15-b6cf23388141]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fb0971-789a-4722-99c5-b2e5b3155c55]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 (non-flash)
Nov 30 09:23:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50fe9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[587fa258-085f-4def-ab36-4776326d8ea3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8be85-fe44-44e7-ae37-22d35e0d79e5]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[da079ff2-993b-4cb5-a487-361b2fb0ed07]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.104s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[014db70f-8e60-44ee-954c-d06a5c0620c1]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06f529b-be76-48a9-bddd-74a31ec37aea]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4c684-1d49-4f55-bbee-1602841ef2cc]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260]
Nov 30 09:23:04 user nova-compute[75340]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409, portal: 172.16.0.220,3260] successful.
Nov 30 09:23:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8ac3b7-b93a-48dd-a76f-312535a08409 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0324e80-803a-4f36-b7f0-98df37c15f8b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== disconnect_volume: return (417ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:23:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5a4fb4f1-f044-4cf3-931e-92cd478850ed tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.029s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:05 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:23:05 user nova-compute[75340]: INFO nova.compute.claims [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Claim successful on node user
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:23:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.policy [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52476e558c849af9399b952decd75f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2c3d22b4a43208d002d0a7f619c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:23:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Creating image(s)
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "/opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "/opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "/opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk 1073741824" returned: 0 in 0.056s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Successfully created port: 209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.212s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Cannot resize image /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Ensure instance console log exists: /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-changed-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Refreshing instance network info cache due to event network-changed-c57b695b-790c-46f8-acab-abc09cccf781. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Refreshing network info cache for port c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Successfully updated port: 209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquired lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-changed-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Refreshing instance network info cache due to event network-changed-209b2043-26ba-43ac-bc96-80b2188336ad. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] Acquiring lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updating instance_info_cache with network_info: [{"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Releasing lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Instance network_info: |[{"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] Acquired lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.neutron [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Refreshing network info cache for port 209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Start _get_guest_xml network_info=[{"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updated VIF entry in instance network info cache for port c57b695b-790c-46f8-acab-abc09cccf781. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8bd71fa-213c-44fa-9cd8-20123b11ccb6 req-bed51c07-035d-4931-845b-08b5e71c289f service nova] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:08 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:08 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989088735',display_name='tempest-VolumesSnapshotTestJSON-instance-989088735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989088735',id=27,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnV1ps1HRFSn/VfnskK/vSHeW9LVuYYls+t/0rCboj2WsaZ//R0xugkl9zuYaichUDxRqgRDbN+8pnVjzs9Y9fYQzrxz9+x/7z1oEtwGeNkRljzHfp2aU7bMul4y4FbHA==',key_name='tempest-keypair-1809266032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-9gyq53vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=e16dac95-3174-4d9b-b6f5-d043e05f2c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'pci_devices' on Instance uuid e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:23:08 user nova-compute[75340]:   <uuid>e16dac95-3174-4d9b-b6f5-d043e05f2c79</uuid>
Nov 30 09:23:08 user nova-compute[75340]:   <name>instance-0000001b</name>
Nov 30 09:23:08 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:23:08 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:23:08 user nova-compute[75340]:   <metadata>
Nov 30 09:23:08 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:23:08 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-989088735</nova:name>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:23:08</nova:creationTime>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:23:08 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:23:08 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:owner>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:user uuid="a52476e558c849af9399b952decd75f3">tempest-VolumesSnapshotTestJSON-1914221383-project-member</nova:user>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:project uuid="efd2c3d22b4a43208d002d0a7f619c4b">tempest-VolumesSnapshotTestJSON-1914221383</nova:project>
Nov 30 09:23:08 user nova-compute[75340]:       </nova:owner>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:23:08 user nova-compute[75340]:       <nova:ports>
Nov 30 09:23:08 user nova-compute[75340]:         <nova:port uuid="209b2043-26ba-43ac-bc96-80b2188336ad">
Nov 30 09:23:08 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:23:08 user nova-compute[75340]:         </nova:port>
Nov 30 09:23:08 user nova-compute[75340]:       </nova:ports>
Nov 30 09:23:08 user nova-compute[75340]:     </nova:instance>
Nov 30 09:23:08 user nova-compute[75340]:   </metadata>
Nov 30 09:23:08 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:23:08 user nova-compute[75340]:     <system>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="serial">e16dac95-3174-4d9b-b6f5-d043e05f2c79</entry>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="uuid">e16dac95-3174-4d9b-b6f5-d043e05f2c79</entry>
Nov 30 09:23:08 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:23:08 user nova-compute[75340]:     </system>
Nov 30 09:23:08 user nova-compute[75340]:   </sysinfo>
Nov 30 09:23:08 user nova-compute[75340]:   <os>
Nov 30 09:23:08 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:23:08 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:23:08 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:23:08 user nova-compute[75340]:   </os>
Nov 30 09:23:08 user nova-compute[75340]:   <features>
Nov 30 09:23:08 user nova-compute[75340]:     <acpi/>
Nov 30 09:23:08 user nova-compute[75340]:     <apic/>
Nov 30 09:23:08 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:23:08 user nova-compute[75340]:   </features>
Nov 30 09:23:08 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:23:08 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:23:08 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:23:08 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:23:08 user nova-compute[75340]:   </clock>
Nov 30 09:23:08 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:23:08 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:23:08 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:23:08 user nova-compute[75340]:   </cpu>
Nov 30 09:23:08 user nova-compute[75340]:   <devices>
Nov 30 09:23:08 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:23:08 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:23:08 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk"/>
Nov 30 09:23:08 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:23:08 user nova-compute[75340]:     </disk>
Nov 30 09:23:08 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:23:08 user nova-compute[75340]:       <mac address="fa:16:3e:11:92:7b"/>
Nov 30 09:23:08 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:08 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:23:08 user nova-compute[75340]:       <target dev="tap209b2043-26"/>
Nov 30 09:23:08 user nova-compute[75340]:     </interface>
Nov 30 09:23:08 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:23:08 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/console.log" append="off"/>
Nov 30 09:23:08 user nova-compute[75340]:     </serial>
Nov 30 09:23:08 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:23:08 user nova-compute[75340]:     <video>
Nov 30 09:23:08 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:08 user nova-compute[75340]:     </video>
Nov 30 09:23:08 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:23:08 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:23:08 user nova-compute[75340]:     </rng>
Nov 30 09:23:08 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:23:08 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:23:08 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:23:08 user nova-compute[75340]:     </memballoon>
Nov 30 09:23:08 user nova-compute[75340]:   </devices>
Nov 30 09:23:08 user nova-compute[75340]: </domain>
Nov 30 09:23:08 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989088735',display_name='tempest-VolumesSnapshotTestJSON-instance-989088735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989088735',id=27,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnV1ps1HRFSn/VfnskK/vSHeW9LVuYYls+t/0rCboj2WsaZ//R0xugkl9zuYaichUDxRqgRDbN+8pnVjzs9Y9fYQzrxz9+x/7z1oEtwGeNkRljzHfp2aU7bMul4y4FbHA==',key_name='tempest-keypair-1809266032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-9gyq53vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=e16dac95-3174-4d9b-b6f5-d043e05f2c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG os_vif [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c27d0fbe-0efb-5d58-b205-5d9b82075c69', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap209b2043-26, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap209b2043-26, col_values=(('qos', UUID('aa4317ae-50c7-484c-9b28-842a43ebfb2d')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap209b2043-26, col_values=(('external_ids', {'iface-id': '209b2043-26ba-43ac-bc96-80b2188336ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:92:7b', 'vm-uuid': 'e16dac95-3174-4d9b-b6f5-d043e05f2c79'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:08 user nova-compute[75340]: INFO os_vif [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26')
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No VIF found with MAC fa:16:3e:11:92:7b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:23:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updated VIF entry in instance network info cache for port 209b2043-26ba-43ac-bc96-80b2188336ad. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updating instance_info_cache with network_info: [{"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a59031d3-6b92-43f9-b42d-50d6e5c249f7 req-f410bb28-9dad-469f-9ec0-d748361620ec service nova] Releasing lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] No waiting events found dispatching network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:10 user nova-compute[75340]: WARNING nova.compute.manager [req-124f4d45-f7b8-4dd0-bbd4-08d7edb6ee92 req-315f94e9-6197-4532-8a13-3f4446f75c0c service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received unexpected event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad for instance with vm_state building and task_state spawning.
Nov 30 09:23:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:11 user nova-compute[75340]: INFO nova.compute.manager [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Attaching volume e5d84218-9418-4cee-b037-f4e84aacca77 to /dev/vdb
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.utils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cdd8b8-6d75-4717-a6ab-ed0cc98fd480]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4905fb-cfd6-46e4-9199-24e0630934fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78e086-bb89-4214-8ecf-e8d7f60cf749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe7ad2-cd94-4283-8f96-5cda492f5f56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:23:11 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:23:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fb83b-08be-424a-969f-4c45d55e84ba]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG os_brick.utils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating existing volume attachment record: 8af458d8-e2e2-46e6-ba28-af1a3eb2af9b {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] No waiting events found dispatching network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:12 user nova-compute[75340]: WARNING nova.compute.manager [req-e8202f7b-f900-4c80-a6f5-4b26ac5f8a7c req-ddc7adfa-ee8a-498d-8d31-0bb647068ca8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received unexpected event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad for instance with vm_state building and task_state spawning.
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:23:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Instance spawned successfully.
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:12 user nova-compute[75340]: INFO nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:23:12 user nova-compute[75340]: INFO nova.compute.manager [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Took 7.12 seconds to build instance.
Nov 30 09:23:12 user nova-compute[75340]: INFO nova.compute.manager [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Rescuing
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:23:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ec88e329-7b5b-4138-ae7b-304387c67957 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:13 user nova-compute[75340]: WARNING nova.compute.manager [req-bc00fd9a-36a7-4e39-b555-92b94ffedd81 req-ff444538-d868-4e86-b364-b06ceecf5577 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state active and task_state rescuing.
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance destroyed successfully.
Nov 30 09:23:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Attempting rescue
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:23:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Creating image(s)
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue" returned: 0 in 0.055s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'migration_context' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.base [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<59ea1092-6591-4aae-aabd-325ed17ac394> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start _get_guest_xml network_info=[{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:5a:01:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.base [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<59ea1092-6591-4aae-aabd-325ed17ac394> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'numa_topology' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.base [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<59ea1092-6591-4aae-aabd-325ed17ac394> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:23:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.base [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<59ea1092-6591-4aae-aabd-325ed17ac394> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1711078597',display_name='tempest-ServerRescueNegativeTestJSON-server-1711078597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1711078597',id=19,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-4k020rwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:18:37Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=59ea1092-6591-4aae-aabd-325ed17ac394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:5a:01:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:5a:01:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.objects.base [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<59ea1092-6591-4aae-aabd-325ed17ac394> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:23:14 user nova-compute[75340]:   <uuid>59ea1092-6591-4aae-aabd-325ed17ac394</uuid>
Nov 30 09:23:14 user nova-compute[75340]:   <name>instance-00000013</name>
Nov 30 09:23:14 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:23:14 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:23:14 user nova-compute[75340]:   <metadata>
Nov 30 09:23:14 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:23:14 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1711078597</nova:name>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:23:14</nova:creationTime>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:23:14 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:23:14 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:owner>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:23:14 user nova-compute[75340]:       </nova:owner>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:23:14 user nova-compute[75340]:       <nova:ports>
Nov 30 09:23:14 user nova-compute[75340]:         <nova:port uuid="127608c1-d377-41d8-878e-8e3cec2f14d6">
Nov 30 09:23:14 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 09:23:14 user nova-compute[75340]:         </nova:port>
Nov 30 09:23:14 user nova-compute[75340]:       </nova:ports>
Nov 30 09:23:14 user nova-compute[75340]:     </nova:instance>
Nov 30 09:23:14 user nova-compute[75340]:   </metadata>
Nov 30 09:23:14 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:23:14 user nova-compute[75340]:     <system>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="serial">59ea1092-6591-4aae-aabd-325ed17ac394</entry>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="uuid">59ea1092-6591-4aae-aabd-325ed17ac394</entry>
Nov 30 09:23:14 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:23:14 user nova-compute[75340]:     </system>
Nov 30 09:23:14 user nova-compute[75340]:   </sysinfo>
Nov 30 09:23:14 user nova-compute[75340]:   <os>
Nov 30 09:23:14 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:23:14 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:23:14 user nova-compute[75340]:   </os>
Nov 30 09:23:14 user nova-compute[75340]:   <features>
Nov 30 09:23:14 user nova-compute[75340]:     <acpi/>
Nov 30 09:23:14 user nova-compute[75340]:     <apic/>
Nov 30 09:23:14 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:23:14 user nova-compute[75340]:   </features>
Nov 30 09:23:14 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:23:14 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:23:14 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:23:14 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:23:14 user nova-compute[75340]:   </clock>
Nov 30 09:23:14 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:23:14 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:23:14 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:23:14 user nova-compute[75340]:   </cpu>
Nov 30 09:23:14 user nova-compute[75340]:   <devices>
Nov 30 09:23:14 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:23:14 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:23:14 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue"/>
Nov 30 09:23:14 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:23:14 user nova-compute[75340]:     </disk>
Nov 30 09:23:14 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:23:14 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:23:14 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk"/>
Nov 30 09:23:14 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:23:14 user nova-compute[75340]:     </disk>
Nov 30 09:23:14 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:23:14 user nova-compute[75340]:       <mac address="fa:16:3e:5a:01:00"/>
Nov 30 09:23:14 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:14 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:23:14 user nova-compute[75340]:       <target dev="tap127608c1-d3"/>
Nov 30 09:23:14 user nova-compute[75340]:     </interface>
Nov 30 09:23:14 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:23:14 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/console.log" append="off"/>
Nov 30 09:23:14 user nova-compute[75340]:     </serial>
Nov 30 09:23:14 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:23:14 user nova-compute[75340]:     <video>
Nov 30 09:23:14 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:14 user nova-compute[75340]:     </video>
Nov 30 09:23:14 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:23:14 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:23:14 user nova-compute[75340]:     </rng>
Nov 30 09:23:14 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:23:14 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:23:14 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:23:14 user nova-compute[75340]:     </memballoon>
Nov 30 09:23:14 user nova-compute[75340]:   </devices>
Nov 30 09:23:14 user nova-compute[75340]: </domain>
Nov 30 09:23:14 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:23:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance destroyed successfully.
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:5a:01:00, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:23:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9455558a-7e24-449d-a515-436c818bf5c4 is timed out.
Nov 30 09:23:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully detached device vdb from instance 9455558a-7e24-449d-a515-436c818bf5c4 from the live domain config.
Nov 30 09:23:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHwlUaBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:23:15 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad0834-510d-49c0-88dd-8cc65759ff49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:23:15 user nova-compute[75340]: No targets found.
Nov 30 09:23:15 user nova-compute[75340]: iSNS:
Nov 30 09:23:15 user nova-compute[75340]: No targets found.
Nov 30 09:23:15 user nova-compute[75340]: STATIC:
Nov 30 09:23:15 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:23:15 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:15 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:15 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:23:15 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:15 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:15 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2
Nov 30 09:23:15 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:15 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:15 user nova-compute[75340]: FIRMWARE:
Nov 30 09:23:15 user nova-compute[75340]: No targets found.
Nov 30 09:23:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:23:15 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:23:15 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b365f714-7246-4107-b73a-e58514c6abe4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ba2a6-d0b9-4d23-b74d-db855ac547ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:15 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:23:15 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:15 user nova-compute[75340]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 (non-flash)
Nov 30 09:23:15 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305e1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2'): ({'sdj'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Removing single pathed devices sdj {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee0c095-12d2-4679-b08b-7ab66a1314ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3755a-6812-40b6-a1c8-86c6ee3ef617]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flushing IO for device /dev/sdj {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6585d753-f3bf-4932-babf-b4e9b9b061c3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c766588-9033-48dd-ba0f-427d944c0f98]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] SCSI volumes sdj have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:15 user nova-compute[75340]: WARNING nova.compute.manager [req-762d7c02-d0fe-4aeb-b512-5aa581c14683 req-9306528f-29ec-43a3-825d-5204fa67d608 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state active and task_state rescuing.
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f963bf7-dc42-46d9-a358-f00cea683916]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a72e6e-5896-4c4f-9437-b5829100d0e0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260]
Nov 30 09:23:15 user nova-compute[75340]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:23:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b125b8-d57c-4de9-89ea-0a0d34a387d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[785041d7-8a29-499a-832b-30559498d449]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== disconnect_volume: return (358ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:23:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'flavor' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3be08680-2cad-41c0-a0be-67d4f75cf5b4 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.946s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:17 user nova-compute[75340]: WARNING nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state active and task_state rescuing.
Nov 30 09:23:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:17 user nova-compute[75340]: WARNING nova.compute.manager [req-8e4e53ed-7224-4f89-8fc3-bbf991e604d7 req-9029fde5-1739-4a0f-86f3-cdd9dac71693 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state active and task_state rescuing.
Nov 30 09:23:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b334fe0d-56e7-4233-a5fc-5c8e4fa181b9 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:23:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:23:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:23:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:23:21 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[271ac9fb-411f-48b7-b620-d15099133731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:23:21 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff2284-5b53-410b-8a87-8745b9b77a8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77] added
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1c44c8-34c9-4ec0-a89b-85c077a375e7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5fcba-4b5f-439b-9ddd-dfadaca245e8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owAkBWUK {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owAkBWUK" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d622bd3-a445-4e5a-83d1-de453167fab6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'owAkBWUK'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece8c92-265f-4cf5-b5f4-97b8583643e6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c116151-a83d-474b-b273-1a5cb309de31]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed1ca3-0cad-499c-9634-a74db6d3e868]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]
Nov 30 09:23:21 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713c6c5-5a5d-4d6a-a257-96d29a18001e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1aa98b-2826-4c12-8391-f4a9269f55d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:23:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bfb6d6-0eb3-4b95-bc32-aa946b174ba0]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:23:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:23:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:23:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23361393436646433', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:23:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361393436646433', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:23:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:23:22 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:23:22 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:23:22 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:23:22 user nova-compute[75340]:   <serial>e5d84218-9418-4cee-b037-f4e84aacca77</serial>
Nov 30 09:23:22 user nova-compute[75340]: </disk>
Nov 30 09:23:22 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No VIF found with MAC fa:16:3e:d4:c0:a7, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9f3dce46-92ad-4c34-acba-3e98f928d7d6 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.558s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75340) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.objects.instance [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:23:24 user nova-compute[75340]: INFO nova.compute.claims [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Claim successful on node user
Nov 30 09:23:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:23:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance destroyed successfully.
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.policy [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0f0a6a4a8584208ad2d68fed45b1690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c54b843022432bafa59fd390295051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:23:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Creating image(s)
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-984de0dc-0428-474c-95eb-77840e8d4066 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.012s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk 1073741824" returned: 0 in 0.067s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:23:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Successfully created port: 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Cannot resize image /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Ensure instance console log exists: /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:26 user nova-compute[75340]: WARNING nova.compute.manager [req-3d65f11c-c3c4-4356-869b-5224f662c0ca req-a68d1237-be72-42b0-987e-0a6c8ba08da3 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state None.
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Successfully updated port: 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing instance network info cache due to event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance network_info: |[{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.neutron [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start _get_guest_xml network_info=[{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:23:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343741322',display_name='tempest-ServerStableDeviceRescueTest-server-1343741322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343741322',id=28,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK//0qfgJiAJATINPwpjaLe+8XrtpIroRuzvuqCk3Hbe1RPiMwJph2CAXpAXmLft/ZFSoluxkoSRKCDyp37zwJA1eCdsVckeSk3KzBwxnxelxiViAGU063NTV3weUycR3A==',key_name='tempest-keypair-427914405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20c54b843022432bafa59fd390295051',ramdisk_id='',reservation_id='r-yi7ltvaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1657990061',owner_user_name='tempest-ServerStableDeviceRescueTest-1657990061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0f0a6a4a8584208ad2d68fed45b1690',uuid=be9c04f6-a829-40a7-90aa-9de247e82875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converting VIF {"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'pci_devices' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:23:27 user nova-compute[75340]:   <uuid>be9c04f6-a829-40a7-90aa-9de247e82875</uuid>
Nov 30 09:23:27 user nova-compute[75340]:   <name>instance-0000001c</name>
Nov 30 09:23:27 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:23:27 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:23:27 user nova-compute[75340]:   <metadata>
Nov 30 09:23:27 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:23:27 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1343741322</nova:name>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:23:27</nova:creationTime>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:23:27 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:23:27 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:owner>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:user uuid="b0f0a6a4a8584208ad2d68fed45b1690">tempest-ServerStableDeviceRescueTest-1657990061-project-member</nova:user>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:project uuid="20c54b843022432bafa59fd390295051">tempest-ServerStableDeviceRescueTest-1657990061</nova:project>
Nov 30 09:23:27 user nova-compute[75340]:       </nova:owner>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:23:27 user nova-compute[75340]:       <nova:ports>
Nov 30 09:23:27 user nova-compute[75340]:         <nova:port uuid="6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7">
Nov 30 09:23:27 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:23:27 user nova-compute[75340]:         </nova:port>
Nov 30 09:23:27 user nova-compute[75340]:       </nova:ports>
Nov 30 09:23:27 user nova-compute[75340]:     </nova:instance>
Nov 30 09:23:27 user nova-compute[75340]:   </metadata>
Nov 30 09:23:27 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:23:27 user nova-compute[75340]:     <system>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="serial">be9c04f6-a829-40a7-90aa-9de247e82875</entry>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="uuid">be9c04f6-a829-40a7-90aa-9de247e82875</entry>
Nov 30 09:23:27 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:23:27 user nova-compute[75340]:     </system>
Nov 30 09:23:27 user nova-compute[75340]:   </sysinfo>
Nov 30 09:23:27 user nova-compute[75340]:   <os>
Nov 30 09:23:27 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:23:27 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:23:27 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:23:27 user nova-compute[75340]:   </os>
Nov 30 09:23:27 user nova-compute[75340]:   <features>
Nov 30 09:23:27 user nova-compute[75340]:     <acpi/>
Nov 30 09:23:27 user nova-compute[75340]:     <apic/>
Nov 30 09:23:27 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:23:27 user nova-compute[75340]:   </features>
Nov 30 09:23:27 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:23:27 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:23:27 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:23:27 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:23:27 user nova-compute[75340]:   </clock>
Nov 30 09:23:27 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:23:27 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:23:27 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:23:27 user nova-compute[75340]:   </cpu>
Nov 30 09:23:27 user nova-compute[75340]:   <devices>
Nov 30 09:23:27 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:23:27 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:23:27 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk"/>
Nov 30 09:23:27 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:23:27 user nova-compute[75340]:     </disk>
Nov 30 09:23:27 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:23:27 user nova-compute[75340]:       <mac address="fa:16:3e:72:7a:1b"/>
Nov 30 09:23:27 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:27 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:23:27 user nova-compute[75340]:       <target dev="tap6d684f04-c5"/>
Nov 30 09:23:27 user nova-compute[75340]:     </interface>
Nov 30 09:23:27 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:23:27 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/console.log" append="off"/>
Nov 30 09:23:27 user nova-compute[75340]:     </serial>
Nov 30 09:23:27 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:23:27 user nova-compute[75340]:     <video>
Nov 30 09:23:27 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:23:27 user nova-compute[75340]:     </video>
Nov 30 09:23:27 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:23:27 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:23:27 user nova-compute[75340]:     </rng>
Nov 30 09:23:27 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:23:27 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:23:27 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:23:27 user nova-compute[75340]:     </memballoon>
Nov 30 09:23:27 user nova-compute[75340]:   </devices>
Nov 30 09:23:27 user nova-compute[75340]: </domain>
Nov 30 09:23:27 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343741322',display_name='tempest-ServerStableDeviceRescueTest-server-1343741322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343741322',id=28,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK//0qfgJiAJATINPwpjaLe+8XrtpIroRuzvuqCk3Hbe1RPiMwJph2CAXpAXmLft/ZFSoluxkoSRKCDyp37zwJA1eCdsVckeSk3KzBwxnxelxiViAGU063NTV3weUycR3A==',key_name='tempest-keypair-427914405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20c54b843022432bafa59fd390295051',ramdisk_id='',reservation_id='r-yi7ltvaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1657990061',owner_user_name='tempest-ServerStableDeviceRescueTest-1657990061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0f0a6a4a8584208ad2d68fed45b1690',uuid=be9c04f6-a829-40a7-90aa-9de247e82875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converting VIF {"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG os_vif [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ae4d9d9-c7cc-5b06-82c8-2dac19d99b47', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d684f04-c5, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d684f04-c5, col_values=(('qos', UUID('777c2adb-4ba4-4d96-9bae-41aa58c0f73f')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d684f04-c5, col_values=(('external_ids', {'iface-id': '6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:7a:1b', 'vm-uuid': 'be9c04f6-a829-40a7-90aa-9de247e82875'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:27 user nova-compute[75340]: INFO os_vif [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5')
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No VIF found with MAC fa:16:3e:72:7a:1b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.neutron [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updated VIF entry in instance network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG nova.network.neutron [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-64224d1f-09c8-4c3f-8508-d42690b6a105 req-74acbf6c-0d3c-4e27-bb16-d2a03fb151e9 service nova] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:28 user nova-compute[75340]: WARNING nova.compute.manager [req-0d181891-aa3c-4450-bd6f-03a732699271 req-afc69285-dd4b-4319-bc23-e1a6406dfc41 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state None.
Nov 30 09:23:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:29 user nova-compute[75340]: WARNING nova.compute.manager [req-16078180-b8cf-47ad-bceb-d7d4c1d2a79a req-7c969c2f-11de-449b-a425-37eb2b90141d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state building and task_state spawning.
Nov 30 09:23:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:23:31 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance spawned successfully.
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:23:31 user nova-compute[75340]: INFO nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:23:31 user nova-compute[75340]: INFO nova.compute.manager [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Took 7.19 seconds to build instance.
Nov 30 09:23:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9095c535-8f28-4e1f-a775-3556205051da tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.343s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:31 user nova-compute[75340]: WARNING nova.compute.manager [req-e6ce83ec-f512-4647-b0bf-f23de5b79c3c req-bca2fe5c-87c6-46fd-b361-90cb16a70359 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state active and task_state None.
Nov 30 09:23:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:33 user nova-compute[75340]: INFO nova.compute.manager [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Terminating instance
Nov 30 09:23:33 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-unplugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] No waiting events found dispatching network-vif-unplugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-e123849a-2a88-4d02-8aea-0825b796ca81 req-bc1a0214-2afa-4beb-b673-3157c6db2ca4 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-unplugged-e248fc69-202d-471a-945b-1c109ca11f4b for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:23:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Instance destroyed successfully.
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'resources' on Instance uuid 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185126405',display_name='tempest-AttachVolumeNegativeTest-server-1185126405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185126405',id=24,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FBWVmJX3+4Y0DsXMdg5f83/IejTm/X9IRGKq2/A/0rSd2fqgaPhryIZEK2uaqyh82cjclfNsQbEaT7r9f/K7ILAPuEU6niP9Dd4cQNrAoAb7GYLbkV/4IK0EV2Suxgw==',key_name='tempest-keypair-2142834208',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-uk1e7m3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=33cc4d61-c9d2-420b-87a5-6b9fe188a7b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "e248fc69-202d-471a-945b-1c109ca11f4b", "address": "fa:16:3e:87:c6:a1", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape248fc69-20", "ovs_interfaceid": "e248fc69-202d-471a-945b-1c109ca11f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG os_vif [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape248fc69-20, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38ea1048-8977-4127-a32b-29ea0f22ac11) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:34 user nova-compute[75340]: INFO os_vif [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:c6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e248fc69-202d-471a-945b-1c109ca11f4b,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape248fc69-20')
Nov 30 09:23:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Deleting instance files /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8_del
Nov 30 09:23:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Deletion of /opt/stack/data/nova/instances/33cc4d61-c9d2-420b-87a5-6b9fe188a7b8_del complete
Nov 30 09:23:34 user nova-compute[75340]: INFO nova.compute.manager [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 30 09:23:34 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:23:35 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:35 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Took 0.83 seconds to deallocate network for instance.
Nov 30 09:23:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbff59df-d6e5-4537-8b34-e9773e437e00 req-f2dc080b-20c5-4b30-b2a0-f7351a64c857 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-deleted-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:35 user nova-compute[75340]: INFO nova.compute.manager [req-bbff59df-d6e5-4537-8b34-e9773e437e00 req-f2dc080b-20c5-4b30-b2a0-f7351a64c857 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Neutron deleted interface e248fc69-202d-471a-945b-1c109ca11f4b; detaching it from the instance and deleting it from the info cache
Nov 30 09:23:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-bbff59df-d6e5-4537-8b34-e9773e437e00 req-f2dc080b-20c5-4b30-b2a0-f7351a64c857 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbff59df-d6e5-4537-8b34-e9773e437e00 req-f2dc080b-20c5-4b30-b2a0-f7351a64c857 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Detach interface failed, port_id=e248fc69-202d-471a-945b-1c109ca11f4b, reason: Instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:23:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:35 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] Acquiring lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] No waiting events found dispatching network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:36 user nova-compute[75340]: WARNING nova.compute.manager [req-4711c78a-8c1c-43ad-bc54-86f939b18970 req-dcdeba37-7680-4039-aee0-98e15c49cc90 service nova] [instance: 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8] Received unexpected event network-vif-plugged-e248fc69-202d-471a-945b-1c109ca11f4b for instance with vm_state deleted and task_state None.
Nov 30 09:23:36 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Deleted allocations for instance 33cc4d61-c9d2-420b-87a5-6b9fe188a7b8
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ab79b238-21eb-429a-8812-ee7e3697b95a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "33cc4d61-c9d2-420b-87a5-6b9fe188a7b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:23:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:23:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:23:37 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:23:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:23:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:23:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:42 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:45 user nova-compute[75340]: INFO nova.compute.manager [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Terminating instance
Nov 30 09:23:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-e4e04911-b96f-480a-8d88-0fc032b19cf0 req-6f6bb63e-15b8-4216-a99c-d36c0144761c service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-unplugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:23:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Instance destroyed successfully.
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'resources' on Instance uuid 9455558a-7e24-449d-a515-436c818bf5c4 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-225583100',display_name='tempest-ServerActionsTestOtherA-server-1218651476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-225583100',id=18,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGrHeB+VUHakT4ZAyhqG00EaigFOcrwSzMxTcz39mxi8iWMaM42Az+XQ2wNIUqa+gLF1T6e94KsDNbE4axCh9+O1Jg0eflQIkTm1J4/dUXtO2GqzeWjsNC102CoT15WqQ==',key_name='tempest-keypair-2022201666',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-y00yum7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=9455558a-7e24-449d-a515-436c818bf5c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "address": "fa:16:3e:06:c9:68", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e3ea5-c7", "ovs_interfaceid": "738e3ea5-c7f7-4353-8a1f-a5c9115cb244", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG os_vif [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738e3ea5-c7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81ce79d9-58b2-4bea-8580-4463df80b323) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:46 user nova-compute[75340]: INFO os_vif [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c9:68,bridge_name='br-int',has_traffic_filtering=True,id=738e3ea5-c7f7-4353-8a1f-a5c9115cb244,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e3ea5-c7')
Nov 30 09:23:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Deleting instance files /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4_del
Nov 30 09:23:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Deletion of /opt/stack/data/nova/instances/9455558a-7e24-449d-a515-436c818bf5c4_del complete
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:46 user nova-compute[75340]: INFO nova.compute.manager [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:47 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Took 0.87 seconds to deallocate network for instance.
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-bc258107-5a2f-4c07-a1c2-ebe9e12e87df req-37c4737c-a4bd-49b3-aa62-379a1380ea8c service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-deleted-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:47 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:47 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:23:47 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=25.35845947265625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:23:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] Acquiring lock "9455558a-7e24-449d-a515-436c818bf5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] Lock "9455558a-7e24-449d-a515-436c818bf5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] No waiting events found dispatching network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:48 user nova-compute[75340]: WARNING nova.compute.manager [req-95e8b103-1558-455c-bfe0-e878c4ab1503 req-9a28c60b-15e9-43bc-b05f-e57bf85a6152 service nova] [instance: 9455558a-7e24-449d-a515-436c818bf5c4] Received unexpected event network-vif-plugged-738e3ea5-c7f7-4353-8a1f-a5c9115cb244 for instance with vm_state deleted and task_state None.
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.320s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:48 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Deleted allocations for instance 9455558a-7e24-449d-a515-436c818bf5c4
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-555e6bd6-eca0-4384-a71e-4c83fd09cf63 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "9455558a-7e24-449d-a515-436c818bf5c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:23:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:55 user nova-compute[75340]: INFO nova.compute.manager [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Terminating instance
Nov 30 09:23:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-e142fb92-03db-448f-8bed-803c3496b478 req-848a1ee1-3d1d-4e1e-b726-70c282c2565b service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-unplugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:23:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Instance destroyed successfully.
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.objects.instance [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lazy-loading 'resources' on Instance uuid 279b49b7-6b6f-4d14-bc3a-ae18849bf122 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641542013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-416755434',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTCXj/bN8eRptJpppW4N4j1fn/YNsloXcuZtX0GBClWhsXHbec0IXARtmNxBu/4SjLtfAuXocfFVrVPixDJmFvZffxbnqVApkO7auAJidzOPvO/rk3WhArQd0nUFpwtQ==',key_name='tempest-keypair-1637997159',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24dc7cb1fbef4211bc357a83142f9ae2',ramdisk_id='',reservation_id='r-y9bd3gmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-755520446',owner_user_name='tempest-ServerActionsV293TestJSON-755520446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a28287fd9aa4e5fb60248a68fc79836',uuid=279b49b7-6b6f-4d14-bc3a-ae18849bf122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converting VIF {"id": "7f89c78c-5bf5-4138-858a-01076110bea6", "address": "fa:16:3e:e9:78:31", "network": {"id": "c7440460-c0d4-4ebb-96f4-15d855114fc1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2124192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24dc7cb1fbef4211bc357a83142f9ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f89c78c-5b", "ovs_interfaceid": "7f89c78c-5bf5-4138-858a-01076110bea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_vif [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f89c78c-5b, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a8f9931-20a7-483e-9c36-3e1215648e34) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:23:56 user nova-compute[75340]: INFO os_vif [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:78:31,bridge_name='br-int',has_traffic_filtering=True,id=7f89c78c-5bf5-4138-858a-01076110bea6,network=Network(c7440460-c0d4-4ebb-96f4-15d855114fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f89c78c-5b')
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtcqsMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:23:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ecc85-f007-41df-b33c-3e7234e16c50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:23:56 user nova-compute[75340]: No targets found.
Nov 30 09:23:56 user nova-compute[75340]: iSNS:
Nov 30 09:23:56 user nova-compute[75340]: No targets found.
Nov 30 09:23:56 user nova-compute[75340]: STATIC:
Nov 30 09:23:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73
Nov 30 09:23:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:23:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:23:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:23:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:23:56 user nova-compute[75340]: FIRMWARE:
Nov 30 09:23:56 user nova-compute[75340]: No targets found.
Nov 30 09:23:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:23:56 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:23:56 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c479587-e6ae-4b13-b2f4-d899c0446cfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[709aa2c8-2cf9-4231-981f-09085ec9544b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:56 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:56 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:23:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:23:56 user nova-compute[75340]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 (non-flash)
Nov 30 09:23:56 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:23:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305f6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557ab5f-46cd-4e1a-b800-a71a0b338fed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d1abb-d8e8-48cf-8212-9b9e4b6a8ee7]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003425d-f3f7-467e-b14b-d94a33f10400]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa5b6b-1e4d-4c07-a130-a60e1274d040]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[067eef9c-1554-4f5b-a6c4-839588e3ea0a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42e7c0-4b76-4b07-b407-29d719c749d9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260]
Nov 30 09:23:56 user nova-compute[75340]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73, portal: 172.16.0.220,3260] successful.
Nov 30 09:23:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd197763-bcf4-4069-95c4-a818fa2dfa73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a77d1-7093-4546-9028-02515340cbe7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] <== disconnect_volume: return (344ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:23:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deleting instance files /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122_del
Nov 30 09:23:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deletion of /opt/stack/data/nova/instances/279b49b7-6b6f-4d14-bc3a-ae18849bf122_del complete
Nov 30 09:23:56 user nova-compute[75340]: INFO nova.compute.manager [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 30 09:23:56 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:23:56 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-3e86666b-d9bb-4176-afb0-f8a30272c265 req-c6ac16e7-63f9-4fc6-988b-c6d0d3a67353 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-deleted-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:57 user nova-compute[75340]: INFO nova.compute.manager [req-3e86666b-d9bb-4176-afb0-f8a30272c265 req-c6ac16e7-63f9-4fc6-988b-c6d0d3a67353 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Neutron deleted interface 7f89c78c-5bf5-4138-858a-01076110bea6; detaching it from the instance and deleting it from the info cache
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-3e86666b-d9bb-4176-afb0-f8a30272c265 req-c6ac16e7-63f9-4fc6-988b-c6d0d3a67353 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:23:57 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Took 0.70 seconds to deallocate network for instance.
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-3e86666b-d9bb-4176-afb0-f8a30272c265 req-c6ac16e7-63f9-4fc6-988b-c6d0d3a67353 service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Detach interface failed, port_id=7f89c78c-5bf5-4138-858a-01076110bea6, reason: Instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] Acquiring lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] No waiting events found dispatching network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:23:57 user nova-compute[75340]: WARNING nova.compute.manager [req-57397ce4-a7d4-4ee1-91a1-58a09acc2e69 req-adc2769b-e252-44e9-8248-f4cb29fb831c service nova] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Received unexpected event network-vif-plugged-7f89c78c-5bf5-4138-858a-01076110bea6 for instance with vm_state active and task_state deleting.
Nov 30 09:23:58 user nova-compute[75340]: INFO nova.compute.manager [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Took 0.88 seconds to detach 1 volumes for instance.
Nov 30 09:23:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] [instance: 279b49b7-6b6f-4d14-bc3a-ae18849bf122] Deleting volume: dd197763-bcf4-4069-95c4-a818fa2dfa73 {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:58 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Deleted allocations for instance 279b49b7-6b6f-4d14-bc3a-ae18849bf122
Nov 30 09:23:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-74201a73-a044-40b7-874c-86ca9d04ed9e tempest-ServerActionsV293TestJSON-755520446 tempest-ServerActionsV293TestJSON-755520446-project-member] Lock "279b49b7-6b6f-4d14-bc3a-ae18849bf122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:23:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:24:13 user nova-compute[75340]: INFO nova.compute.manager [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] instance snapshotting
Nov 30 09:24:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Beginning live snapshot process
Nov 30 09:24:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326.delta 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326.delta 1073741824" returned: 0 in 0.058s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 09:24:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:24:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 74711040 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:24:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:24:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 09:24:16 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:24:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326.delta /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326.delta /opt/stack/data/nova/instances/snapshots/tmpmf6agu9q/f9430a53f1344cb8bd93ec77390be326" returned: 0 in 0.415s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Snapshot extracted, beginning image upload
Nov 30 09:24:19 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Snapshot image upload complete
Nov 30 09:24:19 user nova-compute[75340]: INFO nova.compute.manager [None req-dce9cb5f-81f6-4b6c-b76f-2ccc01c669f1 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Took 5.63 seconds to snapshot the instance on the hypervisor.
Nov 30 09:24:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:24:27 user nova-compute[75340]: INFO nova.compute.claims [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Claim successful on node user
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:24:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.policy [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea3a2d5bc1c47ea988021ed23683f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddb2f89853f41d08fbeb37811d9d4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:24:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Creating image(s)
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "/opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "/opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk 1073741824" returned: 0 in 0.057s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Successfully created port: 860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Cannot resize image /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Ensure instance console log exists: /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Successfully updated port: 860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquired lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-changed-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Refreshing instance network info cache due to event network-changed-860cb801-a71f-4e38-b3e8-417c78835694. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] Acquiring lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updating instance_info_cache with network_info: [{"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Releasing lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Instance network_info: |[{"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] Acquired lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.neutron [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Refreshing network info cache for port 860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Start _get_guest_xml network_info=[{"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:24:30 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:30 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056260454',display_name='tempest-AttachVolumeNegativeTest-server-2056260454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056260454',id=29,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe98W4FJFX+J8gqY/PvTf0wOdGnz8ll//xfaBbCla2ejnUVolNzFkYr9zQuJVrE/5DDcXPHcwbEZn5zdP1Lv5eGn5GySV5Dh/xr55u88bMjkLLwftu5YQbYzfSJYxaojA==',key_name='tempest-keypair-634148261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-q6598jnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=77d012c3-c534-4719-b2fd-b005e7c261b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'pci_devices' on Instance uuid 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:24:30 user nova-compute[75340]:   <uuid>77d012c3-c534-4719-b2fd-b005e7c261b0</uuid>
Nov 30 09:24:30 user nova-compute[75340]:   <name>instance-0000001d</name>
Nov 30 09:24:30 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:24:30 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:24:30 user nova-compute[75340]:   <metadata>
Nov 30 09:24:30 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:24:30 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2056260454</nova:name>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:24:30</nova:creationTime>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:24:30 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:24:30 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:owner>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:user uuid="fea3a2d5bc1c47ea988021ed23683f08">tempest-AttachVolumeNegativeTest-689840258-project-member</nova:user>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:project uuid="4ddb2f89853f41d08fbeb37811d9d4e8">tempest-AttachVolumeNegativeTest-689840258</nova:project>
Nov 30 09:24:30 user nova-compute[75340]:       </nova:owner>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:24:30 user nova-compute[75340]:       <nova:ports>
Nov 30 09:24:30 user nova-compute[75340]:         <nova:port uuid="860cb801-a71f-4e38-b3e8-417c78835694">
Nov 30 09:24:30 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:24:30 user nova-compute[75340]:         </nova:port>
Nov 30 09:24:30 user nova-compute[75340]:       </nova:ports>
Nov 30 09:24:30 user nova-compute[75340]:     </nova:instance>
Nov 30 09:24:30 user nova-compute[75340]:   </metadata>
Nov 30 09:24:30 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:24:30 user nova-compute[75340]:     <system>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="serial">77d012c3-c534-4719-b2fd-b005e7c261b0</entry>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="uuid">77d012c3-c534-4719-b2fd-b005e7c261b0</entry>
Nov 30 09:24:30 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:24:30 user nova-compute[75340]:     </system>
Nov 30 09:24:30 user nova-compute[75340]:   </sysinfo>
Nov 30 09:24:30 user nova-compute[75340]:   <os>
Nov 30 09:24:30 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:24:30 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:24:30 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:24:30 user nova-compute[75340]:   </os>
Nov 30 09:24:30 user nova-compute[75340]:   <features>
Nov 30 09:24:30 user nova-compute[75340]:     <acpi/>
Nov 30 09:24:30 user nova-compute[75340]:     <apic/>
Nov 30 09:24:30 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:24:30 user nova-compute[75340]:   </features>
Nov 30 09:24:30 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:24:30 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:24:30 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:24:30 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:24:30 user nova-compute[75340]:   </clock>
Nov 30 09:24:30 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:24:30 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:24:30 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:24:30 user nova-compute[75340]:   </cpu>
Nov 30 09:24:30 user nova-compute[75340]:   <devices>
Nov 30 09:24:30 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:24:30 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:24:30 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk"/>
Nov 30 09:24:30 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:24:30 user nova-compute[75340]:     </disk>
Nov 30 09:24:30 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:24:30 user nova-compute[75340]:       <mac address="fa:16:3e:9c:82:90"/>
Nov 30 09:24:30 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:24:30 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:24:30 user nova-compute[75340]:       <target dev="tap860cb801-a7"/>
Nov 30 09:24:30 user nova-compute[75340]:     </interface>
Nov 30 09:24:30 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:24:30 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/console.log" append="off"/>
Nov 30 09:24:30 user nova-compute[75340]:     </serial>
Nov 30 09:24:30 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:24:30 user nova-compute[75340]:     <video>
Nov 30 09:24:30 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:24:30 user nova-compute[75340]:     </video>
Nov 30 09:24:30 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:24:30 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:24:30 user nova-compute[75340]:     </rng>
Nov 30 09:24:30 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:24:30 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:24:30 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:24:30 user nova-compute[75340]:     </memballoon>
Nov 30 09:24:30 user nova-compute[75340]:   </devices>
Nov 30 09:24:30 user nova-compute[75340]: </domain>
Nov 30 09:24:30 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056260454',display_name='tempest-AttachVolumeNegativeTest-server-2056260454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056260454',id=29,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe98W4FJFX+J8gqY/PvTf0wOdGnz8ll//xfaBbCla2ejnUVolNzFkYr9zQuJVrE/5DDcXPHcwbEZn5zdP1Lv5eGn5GySV5Dh/xr55u88bMjkLLwftu5YQbYzfSJYxaojA==',key_name='tempest-keypair-634148261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-q6598jnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=77d012c3-c534-4719-b2fd-b005e7c261b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG os_vif [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39cb209c-d632-5420-9bc1-b10af210e5ae', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap860cb801-a7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap860cb801-a7, col_values=(('qos', UUID('409bfabe-2e7a-400d-8408-893e5bc7356f')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap860cb801-a7, col_values=(('external_ids', {'iface-id': '860cb801-a71f-4e38-b3e8-417c78835694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:82:90', 'vm-uuid': '77d012c3-c534-4719-b2fd-b005e7c261b0'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:30 user nova-compute[75340]: INFO os_vif [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7')
Nov 30 09:24:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:24:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:9c:82:90, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:24:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updated VIF entry in instance network info cache for port 860cb801-a71f-4e38-b3e8-417c78835694. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:24:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updating instance_info_cache with network_info: [{"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8ba061da-a981-46a5-b93a-4231d0c9e69e req-63fd5578-b0eb-436a-bce5-16c961866a74 service nova] Releasing lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] No waiting events found dispatching network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:24:32 user nova-compute[75340]: WARNING nova.compute.manager [req-74966bea-9819-4663-a12a-f2f081d407a9 req-4513f479-42af-4651-8783-8ee613a80024 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received unexpected event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 for instance with vm_state building and task_state spawning.
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:24:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Instance spawned successfully.
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:24:34 user nova-compute[75340]: INFO nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] No waiting events found dispatching network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:24:34 user nova-compute[75340]: WARNING nova.compute.manager [req-beb3eba0-c2ac-43a1-a532-f934ba629388 req-5f985a47-eda9-4bb2-a8c0-95af43801fa8 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received unexpected event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 for instance with vm_state building and task_state spawning.
Nov 30 09:24:34 user nova-compute[75340]: INFO nova.compute.manager [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Took 6.84 seconds to build instance.
Nov 30 09:24:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d0f3d630-5d37-4998-868e-18c18957ae5f tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:35 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:24:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:24:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:24:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:24:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:24:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:24:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:24:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:43 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.296905517578125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 77d012c3-c534-4719-b2fd-b005e7c261b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.835s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:24:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:24:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:24:56 user nova-compute[75340]: INFO nova.compute.claims [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Claim successful on node user
Nov 30 09:24:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-changed-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Refreshing instance network info cache due to event network-changed-209b2043-26ba-43ac-bc96-80b2188336ad. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] Acquiring lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] Acquired lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Refreshing network info cache for port 209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:24:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:24:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Ignoring supplied device name: /dev/vdb
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.policy [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a38f18b22334b9a94fbaebca2b89798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113c291d956c434983f43ee4c9d85211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:24:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Creating image(s)
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "/opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "/opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "/opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:57 user nova-compute[75340]: INFO nova.compute.manager [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Attaching volume 0088d78c-ff8c-4017-b55a-10fd6c9fc26b to /dev/vdb
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updated VIF entry in instance network info cache for port 209b2043-26ba-43ac-bc96-80b2188336ad. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updating instance_info_cache with network_info: [{"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-23461e08-d016-4d2b-8b5f-cb9050f633bd req-b97d797f-97bb-411c-a069-df38016c895e service nova] Releasing lock "refresh_cache-e16dac95-3174-4d9b-b6f5-d043e05f2c79" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ece31-95d0-4c2d-acf4-ea059d6cfd5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6374db8-3e3b-49f5-ac57-8275d032b31f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8e5e8-d3d3-4fb7-bf1c-4b52740b3fee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[584364fd-192b-452b-bb8e-c19d617bad0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:24:57 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46a5b8-2e6d-4dae-906f-5ffad9bdd262]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updating existing volume attachment record: 548678a4-4a96-499d-b7f5-6878dcbf81cd {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.210s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Successfully created port: 456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Cannot resize image /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Ensure instance console log exists: /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:24:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Successfully updated port: 456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquired lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-changed-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing instance network info cache due to event network-changed-456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] Acquiring lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating instance_info_cache with network_info: [{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Releasing lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Instance network_info: |[{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] Acquired lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing network info cache for port 456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Start _get_guest_xml network_info=[{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:24:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-493252871',display_name='tempest-TestStampPattern-server-493252871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493252871',id=30,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-5643ha6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:24:57Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=80eb22f8-9079-4cbe-8601-14a994c0b2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'pci_devices' on Instance uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:24:59 user nova-compute[75340]:   <uuid>80eb22f8-9079-4cbe-8601-14a994c0b2e6</uuid>
Nov 30 09:24:59 user nova-compute[75340]:   <name>instance-0000001e</name>
Nov 30 09:24:59 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:24:59 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:24:59 user nova-compute[75340]:   <metadata>
Nov 30 09:24:59 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:24:59 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:name>tempest-TestStampPattern-server-493252871</nova:name>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:24:59</nova:creationTime>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:24:59 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:24:59 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:owner>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:user uuid="9a38f18b22334b9a94fbaebca2b89798">tempest-TestStampPattern-30718589-project-member</nova:user>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:project uuid="113c291d956c434983f43ee4c9d85211">tempest-TestStampPattern-30718589</nova:project>
Nov 30 09:24:59 user nova-compute[75340]:       </nova:owner>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:24:59 user nova-compute[75340]:       <nova:ports>
Nov 30 09:24:59 user nova-compute[75340]:         <nova:port uuid="456bc463-66fd-42b4-9649-daf119172040">
Nov 30 09:24:59 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:24:59 user nova-compute[75340]:         </nova:port>
Nov 30 09:24:59 user nova-compute[75340]:       </nova:ports>
Nov 30 09:24:59 user nova-compute[75340]:     </nova:instance>
Nov 30 09:24:59 user nova-compute[75340]:   </metadata>
Nov 30 09:24:59 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:24:59 user nova-compute[75340]:     <system>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="serial">80eb22f8-9079-4cbe-8601-14a994c0b2e6</entry>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="uuid">80eb22f8-9079-4cbe-8601-14a994c0b2e6</entry>
Nov 30 09:24:59 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:24:59 user nova-compute[75340]:     </system>
Nov 30 09:24:59 user nova-compute[75340]:   </sysinfo>
Nov 30 09:24:59 user nova-compute[75340]:   <os>
Nov 30 09:24:59 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:24:59 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:24:59 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:24:59 user nova-compute[75340]:   </os>
Nov 30 09:24:59 user nova-compute[75340]:   <features>
Nov 30 09:24:59 user nova-compute[75340]:     <acpi/>
Nov 30 09:24:59 user nova-compute[75340]:     <apic/>
Nov 30 09:24:59 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:24:59 user nova-compute[75340]:   </features>
Nov 30 09:24:59 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:24:59 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:24:59 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:24:59 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:24:59 user nova-compute[75340]:   </clock>
Nov 30 09:24:59 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:24:59 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:24:59 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:24:59 user nova-compute[75340]:   </cpu>
Nov 30 09:24:59 user nova-compute[75340]:   <devices>
Nov 30 09:24:59 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:24:59 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:24:59 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk"/>
Nov 30 09:24:59 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:24:59 user nova-compute[75340]:     </disk>
Nov 30 09:24:59 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:24:59 user nova-compute[75340]:       <mac address="fa:16:3e:b0:ca:a2"/>
Nov 30 09:24:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:24:59 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:24:59 user nova-compute[75340]:       <target dev="tap456bc463-66"/>
Nov 30 09:24:59 user nova-compute[75340]:     </interface>
Nov 30 09:24:59 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:24:59 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/console.log" append="off"/>
Nov 30 09:24:59 user nova-compute[75340]:     </serial>
Nov 30 09:24:59 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:24:59 user nova-compute[75340]:     <video>
Nov 30 09:24:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:24:59 user nova-compute[75340]:     </video>
Nov 30 09:24:59 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:24:59 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:24:59 user nova-compute[75340]:     </rng>
Nov 30 09:24:59 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:24:59 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:24:59 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:24:59 user nova-compute[75340]:     </memballoon>
Nov 30 09:24:59 user nova-compute[75340]:   </devices>
Nov 30 09:24:59 user nova-compute[75340]: </domain>
Nov 30 09:24:59 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-493252871',display_name='tempest-TestStampPattern-server-493252871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493252871',id=30,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-5643ha6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:24:57Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=80eb22f8-9079-4cbe-8601-14a994c0b2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG os_vif [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df9db178-1f6f-5d56-8686-3f931476f119', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap456bc463-66, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap456bc463-66, col_values=(('qos', UUID('925ca56d-111b-40b2-93c9-b214ea108277')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap456bc463-66, col_values=(('external_ids', {'iface-id': '456bc463-66fd-42b4-9649-daf119172040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:ca:a2', 'vm-uuid': '80eb22f8-9079-4cbe-8601-14a994c0b2e6'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:24:59 user nova-compute[75340]: INFO os_vif [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66')
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No VIF found with MAC fa:16:3e:b0:ca:a2, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updated VIF entry in instance network info cache for port 456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating instance_info_cache with network_info: [{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:24:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2cc4b-b19b-4c55-8423-c7ea92e33c6b req-520fd35c-57c5-4ba4-80a1-ecd03068c922 service nova] Releasing lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] No waiting events found dispatching network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:01 user nova-compute[75340]: WARNING nova.compute.manager [req-25290340-30ff-4ae2-bd08-b96fa78c8ed9 req-c3bddf1d-15e2-4cf1-9f2e-9d37002fe4e6 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received unexpected event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 for instance with vm_state building and task_state spawning.
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] No waiting events found dispatching network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:03 user nova-compute[75340]: WARNING nova.compute.manager [req-ac61ec03-42a6-43d2-92cd-8bac3acd8853 req-4363ca35-4367-4b13-a676-c9b87bb016ff service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received unexpected event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 for instance with vm_state building and task_state spawning.
Nov 30 09:25:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Instance spawned successfully.
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:03 user nova-compute[75340]: INFO nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:03 user nova-compute[75340]: INFO nova.compute.manager [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Took 7.06 seconds to build instance.
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-244f578e-7d0f-48b5-b30a-2b1fbab35efc tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.200s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:03 user nova-compute[75340]: INFO nova.compute.manager [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Unrescuing
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'flavor' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:04 user nova-compute[75340]: WARNING nova.compute.manager [req-749dfff2-a604-424f-9788-096ee76cac87 req-7c4a72a6-767c-4292-b5dd-e8a65db68969 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:25:05 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance destroyed successfully.
Nov 30 09:25:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:07 user nova-compute[75340]: WARNING nova.compute.manager [req-9600470c-bc5c-4a2d-8e92-7c7d8fcd4768 req-ebbfebbc-a1a8-4472-956e-d3e2721900c0 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:25:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxUQKWXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:07 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:07 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:07 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1293924b-5298-44a2-9d26-71121916270b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:25:07 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1fe03-28a6-4b68-b176-add8560796eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b] added
Nov 30 09:25:07 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[56993ac7-a731-40a8-8970-b28340cc9e92]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca713d-8b36-43ce-95e5-9f995f751ab8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxUQKWXk {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxUQKWXk" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41c8f7-794b-4694-9018-b7929f7bdbc3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxUQKWXk'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4f4499-27da-4c72-9384-c7b91b816770]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a9a5a-d9ed-4f45-a3ec-efdcbe6531f7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:07 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:07 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:07 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:07 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c26c0a-6c35-41e8-ac78-5b6d6ca1e31b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260]
Nov 30 09:25:08 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260] successful.
Nov 30 09:25:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66f21e-04bf-4a9e-9b45-832929d7f937]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbd290-7ef4-4187-a434-1348fe3d3fa5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:08 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:08 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:08 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:08 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06aea48-a998-43ff-9019-5d63e40b93b6]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxUQKWXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:25:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23436336664393937', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436336664393937', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:09 user nova-compute[75340]: WARNING nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:09 user nova-compute[75340]: WARNING nova.compute.manager [req-f17bea09-0300-49c9-9392-7b23e986b5ac req-ef7f90d1-1c86-43b6-93a0-b58a9f33f93a service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.objects.instance [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:25:09 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:25:09 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:25:09 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:25:09 user nova-compute[75340]:   <serial>0088d78c-ff8c-4017-b55a-10fd6c9fc26b</serial>
Nov 30 09:25:09 user nova-compute[75340]: </disk>
Nov 30 09:25:09 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-92e7987c-e317-411b-9150-5cfed1bbfdac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No VIF found with MAC fa:16:3e:11:92:7b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:25:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-84e2a39c-86e4-427d-bb38-48e0bcdbbd4a tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.208s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'info_cache' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing instance network info cache due to event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance destroyed successfully.
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'resources' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:15 user nova-compute[75340]: DEBUG os_vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc57b695b-79, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb2ca52a-cd44-4ce8-bd39-d7b09437fd55) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:16 user nova-compute[75340]: INFO os_vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:16 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.network.neutron [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updated VIF entry in instance network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.network.neutron [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c7dd8-b405-4566-ae4f-19f9242474e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:25:16 user nova-compute[75340]: No targets found.
Nov 30 09:25:16 user nova-compute[75340]: iSNS:
Nov 30 09:25:16 user nova-compute[75340]: No targets found.
Nov 30 09:25:16 user nova-compute[75340]: STATIC:
Nov 30 09:25:16 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:25:16 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:25:16 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:25:16 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b
Nov 30 09:25:16 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:25:16 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:25:16 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:25:16 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:25:16 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:25:16 user nova-compute[75340]: FIRMWARE:
Nov 30 09:25:16 user nova-compute[75340]: No targets found.
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:25:16 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:25:16 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e76cd2d8-2541-4f53-95d8-bbd003727dd4 req-6eac3048-ad04-40c1-b492-b35035b4d9b6 service nova] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260b98b-522a-427e-be09-c24c6e4a29b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[24016e17-d0f7-408a-a4f9-58f8c228ab11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305f4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321e601-eea2-438a-9c0c-63cab1a75740]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[371de7d2-21ff-458d-8907-4e0722913f6d]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c099d-189e-4995-91f6-d5e4eb8c8cd3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21c0cd-722b-4313-8a08-bc0e90850e01]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79eaf2-7594-4708-85f6-a81f181cb688]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f832f183-8b9a-41bb-a787-0f5bc2dd46ba]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]
Nov 30 09:25:16 user nova-compute[75340]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b63071-58e9-44f1-8b4e-075518a66d6e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== disconnect_volume: return (396ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start _get_guest_xml network_info=[{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8af458d8-e2e2-46e6-ba28-af1a3eb2af9b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9c6c4ed4-4acc-4a24-bf80-820a72587045', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5d84218-9418-4cee-b037-f4e84aacca77', 'serial': 'e5d84218-9418-4cee-b037-f4e84aacca77'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:16 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:16 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:16 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469a3e5-d77f-45a0-b24d-55fb5d199e42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:25:16 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c173a84-8526-4cb6-80d2-39aae89835d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77] added
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f29a53-960b-45d7-a175-0d36ca8da520]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee39043-1044-4afb-80d8-ece42023b485]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owAkBWUK {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owAkBWUK" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[abafff0b-9957-48c7-840e-a38d47756511]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'owAkBWUK'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540f90a-5c92-41d5-bde3-0a844c7262b1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5686ba2f-bf0f-4275-aad8-ee11a857a7eb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9f187-ba23-406a-87c2-a58143bb1b60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]
Nov 30 09:25:16 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb0900-1709-4e52-ae87-f0acf4f1d48f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8901a15-eaaa-4b4d-9204-79f9d412e55c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:16 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71977b63-8f97-40cf-8abe-2f09e6e0b491]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:25:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:17 user nova-compute[75340]: INFO nova.compute.manager [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] instance snapshotting
Nov 30 09:25:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Beginning live snapshot process
Nov 30 09:25:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23361393436646433', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361393436646433', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:25:18 user nova-compute[75340]:   <uuid>9c6c4ed4-4acc-4a24-bf80-820a72587045</uuid>
Nov 30 09:25:18 user nova-compute[75340]:   <name>instance-00000019</name>
Nov 30 09:25:18 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:25:18 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:25:18 user nova-compute[75340]:   <metadata>
Nov 30 09:25:18 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:25:18 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeTestJSON-server-1854362006</nova:name>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:25:16</nova:creationTime>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:25:18 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:25:18 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:owner>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:user uuid="82d13c8d8c984172a828f34deb3f9bf6">tempest-AttachVolumeTestJSON-158840588-project-member</nova:user>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:project uuid="cca9314cdc634dfa9df097fcd53c2c2c">tempest-AttachVolumeTestJSON-158840588</nova:project>
Nov 30 09:25:18 user nova-compute[75340]:       </nova:owner>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:25:18 user nova-compute[75340]:       <nova:ports>
Nov 30 09:25:18 user nova-compute[75340]:         <nova:port uuid="c57b695b-790c-46f8-acab-abc09cccf781">
Nov 30 09:25:18 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:25:18 user nova-compute[75340]:         </nova:port>
Nov 30 09:25:18 user nova-compute[75340]:       </nova:ports>
Nov 30 09:25:18 user nova-compute[75340]:     </nova:instance>
Nov 30 09:25:18 user nova-compute[75340]:   </metadata>
Nov 30 09:25:18 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:25:18 user nova-compute[75340]:     <system>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="serial">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="uuid">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:25:18 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:25:18 user nova-compute[75340]:     </system>
Nov 30 09:25:18 user nova-compute[75340]:   </sysinfo>
Nov 30 09:25:18 user nova-compute[75340]:   <os>
Nov 30 09:25:18 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:25:18 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:25:18 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:25:18 user nova-compute[75340]:   </os>
Nov 30 09:25:18 user nova-compute[75340]:   <features>
Nov 30 09:25:18 user nova-compute[75340]:     <acpi/>
Nov 30 09:25:18 user nova-compute[75340]:     <apic/>
Nov 30 09:25:18 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:25:18 user nova-compute[75340]:   </features>
Nov 30 09:25:18 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:25:18 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:25:18 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:25:18 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:25:18 user nova-compute[75340]:   </clock>
Nov 30 09:25:18 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:25:18 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:25:18 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:25:18 user nova-compute[75340]:   </cpu>
Nov 30 09:25:18 user nova-compute[75340]:   <devices>
Nov 30 09:25:18 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:25:18 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:25:18 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk"/>
Nov 30 09:25:18 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:25:18 user nova-compute[75340]:     </disk>
Nov 30 09:25:18 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:25:18 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:25:18 user nova-compute[75340]:       <source dev="/dev/sdd"/>
Nov 30 09:25:18 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:25:18 user nova-compute[75340]:       <serial>e5d84218-9418-4cee-b037-f4e84aacca77</serial>
Nov 30 09:25:18 user nova-compute[75340]:     </disk>
Nov 30 09:25:18 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:25:18 user nova-compute[75340]:       <mac address="fa:16:3e:d4:c0:a7"/>
Nov 30 09:25:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:18 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:25:18 user nova-compute[75340]:       <target dev="tapc57b695b-79"/>
Nov 30 09:25:18 user nova-compute[75340]:     </interface>
Nov 30 09:25:18 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:25:18 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/console.log" append="off"/>
Nov 30 09:25:18 user nova-compute[75340]:     </serial>
Nov 30 09:25:18 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:25:18 user nova-compute[75340]:     <video>
Nov 30 09:25:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:18 user nova-compute[75340]:     </video>
Nov 30 09:25:18 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:25:18 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:25:18 user nova-compute[75340]:     </rng>
Nov 30 09:25:18 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:25:18 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:25:18 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:25:18 user nova-compute[75340]:     </memballoon>
Nov 30 09:25:18 user nova-compute[75340]:   </devices>
Nov 30 09:25:18 user nova-compute[75340]: </domain>
Nov 30 09:25:18 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json -f qcow2" returned: 0 in 0.369s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a.delta 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a.delta 1073741824" returned: 0 in 0.118s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Cannot resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'migration_context' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.objects.base [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG os_vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50fb9c37-fed0-51b1-97e6-b829e26da570', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc57b695b-79, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc57b695b-79, col_values=(('qos', UUID('3ece7067-cd6a-4d25-8608-1c5f95bdc860')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc57b695b-79, col_values=(('external_ids', {'iface-id': 'c57b695b-790c-46f8-acab-abc09cccf781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c0:a7', 'vm-uuid': '9c6c4ed4-4acc-4a24-bf80-820a72587045'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:19 user nova-compute[75340]: INFO os_vif [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:25:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:25:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] COPY block job progress, current cursor: 25624576 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:25:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 09:25:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a.delta /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:20 user nova-compute[75340]: WARNING nova.compute.manager [req-e93d45cd-0679-4498-b1ad-13fc368d380a req-ebf30ee3-b86d-493f-a5eb-a8cc1748bc43 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state powering-on.
Nov 30 09:25:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a.delta /opt/stack/data/nova/instances/snapshots/tmpfjwlraqi/6809bc29a2e44a03b18da1eeaa78240a" returned: 0 in 0.472s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Snapshot extracted, beginning image upload
Nov 30 09:25:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:25:21 user nova-compute[75340]: INFO nova.compute.claims [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Claim successful on node user
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.410s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:25:22 user nova-compute[75340]: INFO nova.compute.claims [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Claim successful on node user
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:25:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.policy [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14f79ef5cc314a3bb971a811a317a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9daa1b03684fb6b29fa66f0f355e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:25:22 user nova-compute[75340]: INFO nova.virt.block_device [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Booting with volume-backed-image a858ddd5-7e49-4452-af44-f170b5cc722b at /dev/vda
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:22 user nova-compute[75340]: WARNING nova.compute.manager [req-22cf6f99-39fa-4ff8-98df-2fc9d6e8bc41 req-ac76f7b4-825e-4ef0-a51f-e39f0c586b88 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state powering-on.
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:25:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance rebooted successfully.
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-5221a622-a681-419d-b974-f9e551821723 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:25:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.policy [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49bf7b06ea4d4c12974e71198ab41be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba603fbafbe4bc6bda4cadaafc64f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Successfully created port: a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:25:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Creating image(s)
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "/opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "/opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Snapshot image upload complete
Nov 30 09:25:24 user nova-compute[75340]: INFO nova.compute.manager [None req-420ec096-4c7e-4b97-a5d3-45b9bbd3b9e0 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Took 6.77 seconds to snapshot the instance on the hypervisor.
Nov 30 09:25:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk 1073741824" returned: 0 in 0.062s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Successfully created port: c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Successfully updated port: a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.221s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-changed-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Refreshing instance network info cache due to event network-changed-a9a06f25-b07d-48e1-979a-2151d4077150. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] Acquiring lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Cannot resize image /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Ensure instance console log exists: /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance network_info: |[{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] Acquired lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Refreshing network info cache for port a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Successfully updated port: c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquired lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-changed-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Refreshing instance network info cache due to event network-changed-c242fb79-8244-4041-80b3-d0be9d997ba3. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] Acquiring lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updated VIF entry in instance network info cache for port a9a06f25-b07d-48e1-979a-2151d4077150. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Updating instance_info_cache with network_info: [{"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f606be0c-83c1-4ffa-b454-27c651ab61fe req-65b65c25-4986-4d64-ade6-6c4eeceb863c service nova] Releasing lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Releasing lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Instance network_info: |[{"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] Acquired lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Refreshing network info cache for port c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Start _get_guest_xml network_info=[{"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:25:25 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:25 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-564562181',display_name='tempest-VolumesActionsTest-instance-564562181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-564562181',id=32,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-u8ld0gic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:24Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=9ebc2a6e-23dd-4168-9e95-b959e92e2078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ebc2a6e-23dd-4168-9e95-b959e92e2078 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:25:25 user nova-compute[75340]:   <uuid>9ebc2a6e-23dd-4168-9e95-b959e92e2078</uuid>
Nov 30 09:25:25 user nova-compute[75340]:   <name>instance-00000020</name>
Nov 30 09:25:25 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:25:25 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:25:25 user nova-compute[75340]:   <metadata>
Nov 30 09:25:25 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:25:25 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:name>tempest-VolumesActionsTest-instance-564562181</nova:name>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:25:25</nova:creationTime>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:25:25 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:25:25 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:owner>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:user uuid="49bf7b06ea4d4c12974e71198ab41be3">tempest-VolumesActionsTest-1790057548-project-member</nova:user>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:project uuid="5ba603fbafbe4bc6bda4cadaafc64f0a">tempest-VolumesActionsTest-1790057548</nova:project>
Nov 30 09:25:25 user nova-compute[75340]:       </nova:owner>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:25:25 user nova-compute[75340]:       <nova:ports>
Nov 30 09:25:25 user nova-compute[75340]:         <nova:port uuid="c242fb79-8244-4041-80b3-d0be9d997ba3">
Nov 30 09:25:25 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:25:25 user nova-compute[75340]:         </nova:port>
Nov 30 09:25:25 user nova-compute[75340]:       </nova:ports>
Nov 30 09:25:25 user nova-compute[75340]:     </nova:instance>
Nov 30 09:25:25 user nova-compute[75340]:   </metadata>
Nov 30 09:25:25 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:25:25 user nova-compute[75340]:     <system>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="serial">9ebc2a6e-23dd-4168-9e95-b959e92e2078</entry>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="uuid">9ebc2a6e-23dd-4168-9e95-b959e92e2078</entry>
Nov 30 09:25:25 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:25:25 user nova-compute[75340]:     </system>
Nov 30 09:25:25 user nova-compute[75340]:   </sysinfo>
Nov 30 09:25:25 user nova-compute[75340]:   <os>
Nov 30 09:25:25 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:25:25 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:25:25 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:25:25 user nova-compute[75340]:   </os>
Nov 30 09:25:25 user nova-compute[75340]:   <features>
Nov 30 09:25:25 user nova-compute[75340]:     <acpi/>
Nov 30 09:25:25 user nova-compute[75340]:     <apic/>
Nov 30 09:25:25 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:25:25 user nova-compute[75340]:   </features>
Nov 30 09:25:25 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:25:25 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:25:25 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:25:25 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:25:25 user nova-compute[75340]:   </clock>
Nov 30 09:25:25 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:25:25 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:25:25 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:25:25 user nova-compute[75340]:   </cpu>
Nov 30 09:25:25 user nova-compute[75340]:   <devices>
Nov 30 09:25:25 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:25:25 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:25:25 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk"/>
Nov 30 09:25:25 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:25:25 user nova-compute[75340]:     </disk>
Nov 30 09:25:25 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:25:25 user nova-compute[75340]:       <mac address="fa:16:3e:a0:1b:c4"/>
Nov 30 09:25:25 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:25 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:25:25 user nova-compute[75340]:       <target dev="tapc242fb79-82"/>
Nov 30 09:25:25 user nova-compute[75340]:     </interface>
Nov 30 09:25:25 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:25:25 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/console.log" append="off"/>
Nov 30 09:25:25 user nova-compute[75340]:     </serial>
Nov 30 09:25:25 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:25:25 user nova-compute[75340]:     <video>
Nov 30 09:25:25 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:25 user nova-compute[75340]:     </video>
Nov 30 09:25:25 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:25:25 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:25:25 user nova-compute[75340]:     </rng>
Nov 30 09:25:25 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:25:25 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:25:25 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:25:25 user nova-compute[75340]:     </memballoon>
Nov 30 09:25:25 user nova-compute[75340]:   </devices>
Nov 30 09:25:25 user nova-compute[75340]: </domain>
Nov 30 09:25:25 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-564562181',display_name='tempest-VolumesActionsTest-instance-564562181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-564562181',id=32,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-u8ld0gic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:24Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=9ebc2a6e-23dd-4168-9e95-b959e92e2078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG os_vif [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c80b7cd3-ac8a-51ce-a783-612c4f35cdfa', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc242fb79-82, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc242fb79-82, col_values=(('qos', UUID('d0f1519f-7037-4abd-942d-3055e645f199')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc242fb79-82, col_values=(('external_ids', {'iface-id': 'c242fb79-8244-4041-80b3-d0be9d997ba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1b:c4', 'vm-uuid': '9ebc2a6e-23dd-4168-9e95-b959e92e2078'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:25 user nova-compute[75340]: INFO os_vif [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82')
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:25:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] No VIF found with MAC fa:16:3e:a0:1b:c4, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:25:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Updated VIF entry in instance network info cache for port c242fb79-8244-4041-80b3-d0be9d997ba3. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:25:26 user nova-compute[75340]: DEBUG nova.network.neutron [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Updating instance_info_cache with network_info: [{"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bb338cb-f4eb-4926-8d78-a2ce77219730 req-f0e3a77b-8099-4888-ae3b-9d4c1ffddb58 service nova] Releasing lock "refresh_cache-9ebc2a6e-23dd-4168-9e95-b959e92e2078" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG nova.compute.manager [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:27 user nova-compute[75340]: DEBUG nova.compute.manager [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] No waiting events found dispatching network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:27 user nova-compute[75340]: WARNING nova.compute.manager [req-4876784d-f4c5-460c-b2ea-bd8e624e79ec req-36b76126-7ac3-4411-94c9-c2fed070d663 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received unexpected event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 for instance with vm_state building and task_state spawning.
Nov 30 09:25:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] No waiting events found dispatching network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:29 user nova-compute[75340]: WARNING nova.compute.manager [req-18c9fefd-0e61-4bda-887a-0f845e3e2083 req-24f3d724-2a22-4515-a33d-bad76969d099 service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received unexpected event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 for instance with vm_state building and task_state spawning.
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:25:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Instance spawned successfully.
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:29 user nova-compute[75340]: INFO nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 30 09:25:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:29 user nova-compute[75340]: INFO nova.compute.manager [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Took 7.78 seconds to build instance.
Nov 30 09:25:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc8ec422-3e71-4272-952f-2c929e34d5e5 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.907s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.utils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac9f30-49a3-488c-bc89-5d9db6715a6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54442e-8d7e-4b54-a8d4-cafc03d5c0c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c78b63-f889-49f1-8336-92f3f236a9bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8a1004-efd9-4c41-8660-654fcd429cd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:25:33 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:25:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bc5b8-d334-4889-9aae-20eebc950a62]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG os_brick.utils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:33 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating existing volume attachment record: 3f0bde0c-6400-4977-94f3-af684d842f7d {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:25:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:25:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:41 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:25:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:25:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:43 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:25:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Creating image(s)
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Ensure instance console log exists: /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start _get_guest_xml network_info=[{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3f0bde0c-6400-4977-94f3-af684d842f7d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0bbdc278-80bc-4c20-87fa-2675a63ea503', 'attached_at': '', 'detached_at': '', 'volume_id': '950b54c0-8c82-4311-9245-3c8b55279459', 'serial': '950b54c0-8c82-4311-9245-3c8b55279459'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:25:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:25:44 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ffdb0-0689-43b3-8f25-86ff214fb098]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:25:44 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd621337-15bb-49cf-b8bf-b84f65db9b69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459] added
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0e427e-0c3b-4dc1-baba-7d1a41ff1abb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1318d14c-423b-4c16-8c1c-f79ddc7ddf2e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MftaXzmW {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MftaXzmW" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43daa75-6927-4a47-9d7c-1d359beb6201]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MftaXzmW'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d383e4-2e6a-4fa6-95a7-eeb873974cb4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a764e8-69e2-4dd0-8021-5ff950cb306f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[05894fb3-161b-41c8-b103-e1741df7d585]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260]
Nov 30 09:25:44 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260] successful.
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a33aa-cbc8-4dd3-b128-9561bdc8e794]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b86056-d06b-450b-b7a8-0c9e41dd0a97]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:25:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74be6f1-e21b-4ed1-93c0-5a547a6d8eb5]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26632386565393561', 'path': '/dev/sde'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632386565393561', 'path': '/dev/sde'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1612015618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1612015618',id=31,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9hm7pqmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:23Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=0bbdc278-80bc-4c20-87fa-2675a63ea503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.objects.instance [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:25:45 user nova-compute[75340]:   <uuid>0bbdc278-80bc-4c20-87fa-2675a63ea503</uuid>
Nov 30 09:25:45 user nova-compute[75340]:   <name>instance-0000001f</name>
Nov 30 09:25:45 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:25:45 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:25:45 user nova-compute[75340]:   <metadata>
Nov 30 09:25:45 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:25:45 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1612015618</nova:name>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:25:44</nova:creationTime>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:25:45 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:25:45 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:owner>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:25:45 user nova-compute[75340]:       </nova:owner>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:25:45 user nova-compute[75340]:       <nova:ports>
Nov 30 09:25:45 user nova-compute[75340]:         <nova:port uuid="a9a06f25-b07d-48e1-979a-2151d4077150">
Nov 30 09:25:45 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 09:25:45 user nova-compute[75340]:         </nova:port>
Nov 30 09:25:45 user nova-compute[75340]:       </nova:ports>
Nov 30 09:25:45 user nova-compute[75340]:     </nova:instance>
Nov 30 09:25:45 user nova-compute[75340]:   </metadata>
Nov 30 09:25:45 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:25:45 user nova-compute[75340]:     <system>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="serial">0bbdc278-80bc-4c20-87fa-2675a63ea503</entry>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="uuid">0bbdc278-80bc-4c20-87fa-2675a63ea503</entry>
Nov 30 09:25:45 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:25:45 user nova-compute[75340]:     </system>
Nov 30 09:25:45 user nova-compute[75340]:   </sysinfo>
Nov 30 09:25:45 user nova-compute[75340]:   <os>
Nov 30 09:25:45 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:25:45 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:25:45 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:25:45 user nova-compute[75340]:   </os>
Nov 30 09:25:45 user nova-compute[75340]:   <features>
Nov 30 09:25:45 user nova-compute[75340]:     <acpi/>
Nov 30 09:25:45 user nova-compute[75340]:     <apic/>
Nov 30 09:25:45 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:25:45 user nova-compute[75340]:   </features>
Nov 30 09:25:45 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:25:45 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:25:45 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:25:45 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:25:45 user nova-compute[75340]:   </clock>
Nov 30 09:25:45 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:25:45 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:25:45 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:25:45 user nova-compute[75340]:   </cpu>
Nov 30 09:25:45 user nova-compute[75340]:   <devices>
Nov 30 09:25:45 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:25:45 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:25:45 user nova-compute[75340]:       <source dev="/dev/sde"/>
Nov 30 09:25:45 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:25:45 user nova-compute[75340]:       <serial>950b54c0-8c82-4311-9245-3c8b55279459</serial>
Nov 30 09:25:45 user nova-compute[75340]:     </disk>
Nov 30 09:25:45 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:25:45 user nova-compute[75340]:       <mac address="fa:16:3e:3b:d7:3c"/>
Nov 30 09:25:45 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:45 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:25:45 user nova-compute[75340]:       <target dev="tapa9a06f25-b0"/>
Nov 30 09:25:45 user nova-compute[75340]:     </interface>
Nov 30 09:25:45 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:25:45 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/console.log" append="off"/>
Nov 30 09:25:45 user nova-compute[75340]:     </serial>
Nov 30 09:25:45 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:25:45 user nova-compute[75340]:     <video>
Nov 30 09:25:45 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:25:45 user nova-compute[75340]:     </video>
Nov 30 09:25:45 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:25:45 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:25:45 user nova-compute[75340]:     </rng>
Nov 30 09:25:45 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:25:45 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:25:45 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:25:45 user nova-compute[75340]:     </memballoon>
Nov 30 09:25:45 user nova-compute[75340]:   </devices>
Nov 30 09:25:45 user nova-compute[75340]: </domain>
Nov 30 09:25:45 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1612015618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1612015618',id=31,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9hm7pqmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:23Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=0bbdc278-80bc-4c20-87fa-2675a63ea503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG os_vif [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fc75677-67dd-5d59-b7c0-d49c96014701', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9a06f25-b0, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9a06f25-b0, col_values=(('qos', UUID('aa6c9d41-a66d-4a37-84e8-21605a95a878')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9a06f25-b0, col_values=(('external_ids', {'iface-id': 'a9a06f25-b07d-48e1-979a-2151d4077150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:d7:3c', 'vm-uuid': '0bbdc278-80bc-4c20-87fa-2675a63ea503'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:45 user nova-compute[75340]: INFO os_vif [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0')
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:3b:d7:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:25:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:47 user nova-compute[75340]: WARNING nova.compute.manager [req-65a13c1a-46d1-458d-b9f8-d79669949176 req-5c596ff7-bb5a-4e9b-982d-1771bc562d41 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state building and task_state spawning.
Nov 30 09:25:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:48 user nova-compute[75340]: INFO nova.compute.manager [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Detaching volume 0088d78c-ff8c-4017-b55a-10fd6c9fc26b
Nov 30 09:25:48 user nova-compute[75340]: INFO nova.virt.block_device [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Attempting to driver detach volume 0088d78c-ff8c-4017-b55a-10fd6c9fc26b from mountpoint /dev/vdb
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Attempting to detach device vdb from instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:25:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:25:49 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:25:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:25:49 user nova-compute[75340]:   <serial>0088d78c-ff8c-4017-b55a-10fd6c9fc26b</serial>
Nov 30 09:25:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:25:49 user nova-compute[75340]: </disk>
Nov 30 09:25:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:25:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully detached device vdb from instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 from the persistent domain config.
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:25:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:25:49 user nova-compute[75340]:   <source dev="/dev/sdc"/>
Nov 30 09:25:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:25:49 user nova-compute[75340]:   <serial>0088d78c-ff8c-4017-b55a-10fd6c9fc26b</serial>
Nov 30 09:25:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:25:49 user nova-compute[75340]: </disk>
Nov 30 09:25:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:25:49 user nova-compute[75340]: WARNING nova.compute.manager [req-2163cbd5-2bdf-43fb-a708-17085ff30ece req-4952ad76-f552-42ab-8b21-f7c0f28b7441 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state building and task_state spawning.
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:25:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance spawned successfully.
Nov 30 09:25:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=25.16626739501953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:25:49 user nova-compute[75340]: INFO nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 30 09:25:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:25:49 user nova-compute[75340]: INFO nova.compute.manager [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Took 28.09 seconds to build instance.
Nov 30 09:25:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-dc34a830-fde6-4f78-a3bb-5aed4450f0c3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.199s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 77d012c3-c534-4719-b2fd-b005e7c261b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9ebc2a6e-23dd-4168-9e95-b959e92e2078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:25:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:25:56 user nova-compute[75340]: INFO nova.compute.claims [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Claim successful on node user
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:25:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:25:56 user nova-compute[75340]: DEBUG nova.policy [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61fabd845c2a4368bab99d4ca469452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2a93601bf545c7b13b34afc2c0da24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:25:56 user nova-compute[75340]: INFO nova.virt.block_device [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Booting with volume 50a841f5-f0f8-4894-96ab-b144633ccfae at /dev/vda
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f82a7-b344-492b-9994-5e2cb1504e8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f4b1c-364d-4d7c-bcfd-a6ba23b2eca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc231306-479b-4add-bb1f-60b111c0e07b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25697f7-08ec-4f32-8674-abeb97476f05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:25:57 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:25:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f860fd67-273a-4c9a-8c94-b22a2b27c587]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating existing volume attachment record: e935ce00-1bcd-43d7-b7c2-d5b3d85b8619 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:25:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Successfully created port: 8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Successfully updated port: 8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-changed-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Refreshing instance network info cache due to event network-changed-8b41d275-a828-4889-9d37-7ced21f5f610. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance network_info: |[{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Refreshing network info cache for port 8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updated VIF entry in instance network info cache for port 8b41d275-a828-4889-9d37-7ced21f5f610. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:25:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13126e2-d506-48c9-a20e-1e436255f7d8 req-dc3fb828-719a-4f2a-96f3-caec66976d1a service nova] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:26:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 is timed out.
Nov 30 09:26:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully detached device vdb from instance e16dac95-3174-4d9b-b6f5-d043e05f2c79 from the live domain config.
Nov 30 09:26:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxUQKWXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122101e-b9cf-4e37-89e4-af2c4476663e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:26:09 user nova-compute[75340]: No targets found.
Nov 30 09:26:09 user nova-compute[75340]: iSNS:
Nov 30 09:26:09 user nova-compute[75340]: No targets found.
Nov 30 09:26:09 user nova-compute[75340]: STATIC:
Nov 30 09:26:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:26:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:26:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b
Nov 30 09:26:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:26:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:09 user nova-compute[75340]: FIRMWARE:
Nov 30 09:26:09 user nova-compute[75340]: No targets found.
Nov 30 09:26:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:26:09 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:26:09 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f30a5-75fb-47ad-9566-56eebacb1275]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2eae85-4606-48a1-a5c5-67ff06bc9d8c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:09 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307b2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f239d-3ab4-4ba7-94ad-0f8e714adce4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f0dd6f-6648-4191-91bd-2a217f74e48f]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d3b92-8b4d-4c35-9b56-595cb80cc95e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb54fe-246f-4fc5-86fc-e18091af231a]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9199c5c-72ae-4e9b-9233-ec9c010c5947]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f81fa97-6359-41ae-a529-514e3c9a6604]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260]
Nov 30 09:26:10 user nova-compute[75340]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b, portal: 172.16.0.220,3260] successful.
Nov 30 09:26:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b4360-c37d-4866-bd3c-59b54c287b72]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== disconnect_volume: return (313ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG nova.objects.instance [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bd3602ec-e51a-46ef-b8aa-2fd0f5cab069 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.815s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:10 user nova-compute[75340]: INFO nova.compute.manager [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Terminating instance
Nov 30 09:26:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-unplugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] No waiting events found dispatching network-vif-unplugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-fb734b32-bdcd-46b5-9608-97754b74525e req-c895015c-23df-4be6-9d9a-f398a9ec44d6 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-unplugged-209b2043-26ba-43ac-bc96-80b2188336ad for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:26:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Instance destroyed successfully.
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'resources' on Instance uuid e16dac95-3174-4d9b-b6f5-d043e05f2c79 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989088735',display_name='tempest-VolumesSnapshotTestJSON-instance-989088735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989088735',id=27,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnV1ps1HRFSn/VfnskK/vSHeW9LVuYYls+t/0rCboj2WsaZ//R0xugkl9zuYaichUDxRqgRDbN+8pnVjzs9Y9fYQzrxz9+x/7z1oEtwGeNkRljzHfp2aU7bMul4y4FbHA==',key_name='tempest-keypair-1809266032',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:23:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-9gyq53vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=e16dac95-3174-4d9b-b6f5-d043e05f2c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "209b2043-26ba-43ac-bc96-80b2188336ad", "address": "fa:16:3e:11:92:7b", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209b2043-26", "ovs_interfaceid": "209b2043-26ba-43ac-bc96-80b2188336ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_vif [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap209b2043-26, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa4317ae-50c7-484c-9b28-842a43ebfb2d) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:11 user nova-compute[75340]: INFO os_vif [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:92:7b,bridge_name='br-int',has_traffic_filtering=True,id=209b2043-26ba-43ac-bc96-80b2188336ad,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209b2043-26')
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxUQKWXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:11 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a9198-8dce-4d41-a535-67cdbcd05275]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:26:11 user nova-compute[75340]: No targets found.
Nov 30 09:26:11 user nova-compute[75340]: iSNS:
Nov 30 09:26:11 user nova-compute[75340]: No targets found.
Nov 30 09:26:11 user nova-compute[75340]: STATIC:
Nov 30 09:26:11 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:26:11 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:11 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:11 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:26:11 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:11 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:11 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:26:11 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:11 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:11 user nova-compute[75340]: FIRMWARE:
Nov 30 09:26:11 user nova-compute[75340]: No targets found.
Nov 30 09:26:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:26:11 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:26:11 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0088d78c-ff8c-4017-b55a-10fd6c9fc26b', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041314b-1f22-46ca-862a-42547d7b91da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12c992-b121-409f-a6cb-1113dd420747]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:11 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:11 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:11 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:11 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305e1b40>, {}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Disconnecting from: [] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== disconnect_volume: return (83ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:26:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Deleting instance files /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79_del
Nov 30 09:26:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Deletion of /opt/stack/data/nova/instances/e16dac95-3174-4d9b-b6f5-d043e05f2c79_del complete
Nov 30 09:26:11 user nova-compute[75340]: INFO nova.compute.manager [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 09:26:11 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:26:11 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:26:12 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:26:12 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Took 0.86 seconds to deallocate network for instance.
Nov 30 09:26:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-d6370b5b-2327-4beb-a7cb-a3da5124dc78 req-32fa9372-eaf5-433a-a7bb-27e54e211983 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-deleted-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:12 user nova-compute[75340]: WARNING nova.volume.cinder [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Attachment 548678a4-4a96-499d-b7f5-6878dcbf81cd does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 548678a4-4a96-499d-b7f5-6878dcbf81cd. (HTTP 404) (Request-ID: req-f5d22fd6-b2c4-4a35-98b8-762d0d679cb3)
Nov 30 09:26:12 user nova-compute[75340]: INFO nova.compute.manager [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Took 0.03 seconds to detach 1 volumes for instance.
Nov 30 09:26:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] Acquiring lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] No waiting events found dispatching network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:26:13 user nova-compute[75340]: WARNING nova.compute.manager [req-c2decbd2-7698-4c45-9834-b27f66fbe48d req-2535cee0-6340-4e5d-a520-1b7abea037d8 service nova] [instance: e16dac95-3174-4d9b-b6f5-d043e05f2c79] Received unexpected event network-vif-plugged-209b2043-26ba-43ac-bc96-80b2188336ad for instance with vm_state deleted and task_state None.
Nov 30 09:26:13 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Deleted allocations for instance e16dac95-3174-4d9b-b6f5-d043e05f2c79
Nov 30 09:26:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7863e34c-5ab3-4649-a17c-59caa881e06d tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "e16dac95-3174-4d9b-b6f5-d043e05f2c79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.620s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:26:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Creating image(s)
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Ensure instance console log exists: /opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start _get_guest_xml network_info=[{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'e935ce00-1bcd-43d7-b7c2-d5b3d85b8619', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1271f7f-d3d0-4d07-b9ee-50592fc9de61', 'attached_at': '', 'detached_at': '', 'volume_id': '50a841f5-f0f8-4894-96ab-b144633ccfae', 'serial': '50a841f5-f0f8-4894-96ab-b144633ccfae'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:26:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:26:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:14 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f87a2a1-7b47-4cbe-860a-b6328a754c97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:26:14 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37a0d89-2a8a-4f62-9311-67d0de1f1b6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae] added
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec825a01-348c-4bf4-a6bb-6bbe20699eeb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc16e6-cd5e-403f-815a-1b4e58ba57e4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsbXIrjP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsbXIrjP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea24fcb-8f7f-46c1-955c-17eb443d2612]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsbXIrjP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[138aea71-641f-476e-b81a-e268383afb06]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba91b53-e833-4a18-93c8-377af1b22d3e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d42948-873d-4e42-ad3f-5da842f8ca6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]
Nov 30 09:26:14 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adef785-5071-4a22-ae6a-4c037cf59efa]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b490152-9fb7-4c81-b883-63a5b0c6196f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:14 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f680c-faaf-448c-9738-4963e5038e23]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:26:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26665303831653164', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665303831653164', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'pci_devices' on Instance uuid f1271f7f-d3d0-4d07-b9ee-50592fc9de61 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:26:15 user nova-compute[75340]:   <uuid>f1271f7f-d3d0-4d07-b9ee-50592fc9de61</uuid>
Nov 30 09:26:15 user nova-compute[75340]:   <name>instance-00000021</name>
Nov 30 09:26:15 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:26:15 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:26:15 user nova-compute[75340]:   <metadata>
Nov 30 09:26:15 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:26:15 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:26:15 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherA-server-290554714</nova:name>
Nov 30 09:26:15 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:26:14</nova:creationTime>
Nov 30 09:26:15 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:26:15 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:26:15 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:26:15 user nova-compute[75340]:       <nova:owner>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:user uuid="61fabd845c2a4368bab99d4ca469452a">tempest-ServerActionsTestOtherA-1563000763-project-member</nova:user>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:project uuid="5c2a93601bf545c7b13b34afc2c0da24">tempest-ServerActionsTestOtherA-1563000763</nova:project>
Nov 30 09:26:15 user nova-compute[75340]:       </nova:owner>
Nov 30 09:26:15 user nova-compute[75340]:       <nova:ports>
Nov 30 09:26:15 user nova-compute[75340]:         <nova:port uuid="8b41d275-a828-4889-9d37-7ced21f5f610">
Nov 30 09:26:15 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:26:15 user nova-compute[75340]:         </nova:port>
Nov 30 09:26:15 user nova-compute[75340]:       </nova:ports>
Nov 30 09:26:15 user nova-compute[75340]:     </nova:instance>
Nov 30 09:26:15 user nova-compute[75340]:   </metadata>
Nov 30 09:26:15 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:26:15 user nova-compute[75340]:     <system>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="serial">f1271f7f-d3d0-4d07-b9ee-50592fc9de61</entry>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="uuid">f1271f7f-d3d0-4d07-b9ee-50592fc9de61</entry>
Nov 30 09:26:15 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:26:15 user nova-compute[75340]:     </system>
Nov 30 09:26:15 user nova-compute[75340]:   </sysinfo>
Nov 30 09:26:15 user nova-compute[75340]:   <os>
Nov 30 09:26:15 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:26:15 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:26:15 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:26:15 user nova-compute[75340]:   </os>
Nov 30 09:26:15 user nova-compute[75340]:   <features>
Nov 30 09:26:15 user nova-compute[75340]:     <acpi/>
Nov 30 09:26:15 user nova-compute[75340]:     <apic/>
Nov 30 09:26:15 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:26:15 user nova-compute[75340]:   </features>
Nov 30 09:26:15 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:26:15 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:26:15 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:26:15 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:26:15 user nova-compute[75340]:   </clock>
Nov 30 09:26:15 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:26:15 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:26:15 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:26:15 user nova-compute[75340]:   </cpu>
Nov 30 09:26:15 user nova-compute[75340]:   <devices>
Nov 30 09:26:15 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:26:15 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:26:15 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:26:15 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:26:15 user nova-compute[75340]:       <serial>50a841f5-f0f8-4894-96ab-b144633ccfae</serial>
Nov 30 09:26:15 user nova-compute[75340]:     </disk>
Nov 30 09:26:15 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:26:15 user nova-compute[75340]:       <mac address="fa:16:3e:d9:b2:d8"/>
Nov 30 09:26:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:26:15 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:26:15 user nova-compute[75340]:       <target dev="tap8b41d275-a8"/>
Nov 30 09:26:15 user nova-compute[75340]:     </interface>
Nov 30 09:26:15 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:26:15 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61/console.log" append="off"/>
Nov 30 09:26:15 user nova-compute[75340]:     </serial>
Nov 30 09:26:15 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:26:15 user nova-compute[75340]:     <video>
Nov 30 09:26:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:26:15 user nova-compute[75340]:     </video>
Nov 30 09:26:15 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:26:15 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:26:15 user nova-compute[75340]:     </rng>
Nov 30 09:26:15 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:26:15 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:26:15 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:26:15 user nova-compute[75340]:     </memballoon>
Nov 30 09:26:15 user nova-compute[75340]:   </devices>
Nov 30 09:26:15 user nova-compute[75340]: </domain>
Nov 30 09:26:15 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG os_vif [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcaf8572-283c-52b8-b290-f982315f8a0c', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b41d275-a8, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b41d275-a8, col_values=(('qos', UUID('872de814-05bc-49ec-b001-789569f35c48')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b41d275-a8, col_values=(('external_ids', {'iface-id': '8b41d275-a828-4889-9d37-7ced21f5f610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:b2:d8', 'vm-uuid': 'f1271f7f-d3d0-4d07-b9ee-50592fc9de61'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:15 user nova-compute[75340]: INFO os_vif [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8')
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:26:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:d9:b2:d8, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:26:17 user nova-compute[75340]: WARNING nova.compute.manager [req-231f4ffe-4cd2-4db0-85ad-4e4ba236828a req-6114befc-9a0a-407e-bf6c-a03c30ea947a service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state building and task_state spawning.
Nov 30 09:26:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:26:19 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance spawned successfully.
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:26:19 user nova-compute[75340]: INFO nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 30 09:26:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:26:19 user nova-compute[75340]: INFO nova.compute.manager [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Took 23.17 seconds to build instance.
Nov 30 09:26:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e96898f0-a04e-4059-895c-a828b639c5c8 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.264s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:26:20 user nova-compute[75340]: WARNING nova.compute.manager [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state active and task_state None.
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-changed-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Refreshing instance network info cache due to event network-changed-860cb801-a71f-4e38-b3e8-417c78835694. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Acquiring lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Acquired lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Refreshing network info cache for port 860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updated VIF entry in instance network info cache for port 860cb801-a71f-4e38-b3e8-417c78835694. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updating instance_info_cache with network_info: [{"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a40dc97-98bd-4f3c-841d-fabb4516e0ef req-fbdf5399-310e-4512-824c-9724c180ec2b service nova] Releasing lock "refresh_cache-77d012c3-c534-4719-b2fd-b005e7c261b0" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:26:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:22 user nova-compute[75340]: INFO nova.compute.manager [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Attaching volume f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a to /dev/vdb
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.utils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[46348905-2889-4db9-baf5-042b916174e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5a5f6-7ef2-4a1b-b616-60f2eb65eea0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d06427-2e7f-42eb-b825-f267aef42fa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[73458a08-d36c-4f4a-bae1-5ce14d5683d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:26:22 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:26:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a188e1db-0d44-4ded-b60d-fcf34558fdb3]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG os_brick.utils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:22 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updating existing volume attachment record: 7006058c-a7e1-4ea8-9d97-3db12a78fdd6 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:26:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CatVThuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:31 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:31 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:31 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa185b4-8b5a-4347-bcc1-5fc604e154d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:26:31 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0521c-3b62-4062-a2a0-a1ce433a3ccf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a] added
Nov 30 09:26:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7295c-e44c-4d1c-a0c2-5f37ebe7c054]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d0d16-94aa-4367-92eb-3226c7106b6b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CatVThuM {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CatVThuM" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b089379-9508-4116-b42c-b9efc5013f7b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CatVThuM'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f145e337-844e-440a-b0f1-5475e19089c8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a0189-9a86-49ff-8c1b-a6f04f64b695]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:31 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:31 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd306f-1db5-4283-a89a-205b39de2692]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260]
Nov 30 09:26:32 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260] successful.
Nov 30 09:26:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f148268-1a75-493d-80b2-0e8ecd1bdd40]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55829776-c9f0-49ed-979b-b98268a68e12]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)
Nov 30 09:26:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:32 user nova-compute[75340]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)
Nov 30 09:26:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[29be8cd4-4542-485f-9304-fcf230fbf2a4]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CatVThuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23766386465303939', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766386465303939', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:26:33 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:26:33 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:26:33 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:26:33 user nova-compute[75340]:   <serial>f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a</serial>
Nov 30 09:26:33 user nova-compute[75340]: </disk>
Nov 30 09:26:33 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] No VIF found with MAC fa:16:3e:9c:82:90, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2f3469f7-021c-4ccf-a7d3-fda9c27186eb tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.609s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:34 user nova-compute[75340]: INFO nova.compute.manager [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Detaching volume f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a
Nov 30 09:26:34 user nova-compute[75340]: INFO nova.virt.block_device [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Attempting to driver detach volume f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a from mountpoint /dev/vdb
Nov 30 09:26:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Attempting to detach device vdb from instance 77d012c3-c534-4719-b2fd-b005e7c261b0 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:26:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:26:34 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:26:34 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:26:34 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:26:34 user nova-compute[75340]:   <serial>f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a</serial>
Nov 30 09:26:34 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:26:34 user nova-compute[75340]: </disk>
Nov 30 09:26:34 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:26:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 77d012c3-c534-4719-b2fd-b005e7c261b0 from the persistent domain config.
Nov 30 09:26:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77d012c3-c534-4719-b2fd-b005e7c261b0 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:26:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:26:34 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:26:34 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:26:34 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:26:34 user nova-compute[75340]:   <serial>f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a</serial>
Nov 30 09:26:34 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:26:34 user nova-compute[75340]: </disk>
Nov 30 09:26:34 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:26:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:26:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:26:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:40 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:26:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:26:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:26:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:26:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:26:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:45 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-changed-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing instance network info cache due to event network-changed-456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] Acquiring lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] Acquired lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing network info cache for port 456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG nova.objects.instance [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updated VIF entry in instance network info cache for port 456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating instance_info_cache with network_info: [{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b8c28610-4c79-4c40-a666-69c7ace5b173 req-754e69f2-4bf4-4216-9b41-2e57174c2511 service nova] Releasing lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:49 user nova-compute[75340]: INFO nova.compute.manager [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Attaching volume 2ba09a50-a252-4e36-851f-1fce0b87ef77 to /dev/vdb
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.utils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e19a24-bf8e-4aa2-92fa-67603dc18eab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3854cfc0-04d8-4ee1-9618-9a6d286e872a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2eaceb-10f8-4adc-989e-2cf5d8f0c8ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc8c44-7009-4ba3-ad61-a92324067dfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:26:49 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[635ec51c-8697-4d0b-b0d4-4525f9d185a6]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG os_brick.utils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating existing volume attachment record: d2830315-e93f-4e27-ad8a-2fc535d37067 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:50 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:26:50 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:26:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7088MB free_disk=25.170631408691406GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 77d012c3-c534-4719-b2fd-b005e7c261b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9ebc2a6e-23dd-4168-9e95-b959e92e2078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:26:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:26:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77d012c3-c534-4719-b2fd-b005e7c261b0 is timed out.
Nov 30 09:26:54 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully detached device vdb from instance 77d012c3-c534-4719-b2fd-b005e7c261b0 from the live domain config.
Nov 30 09:26:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CatVThuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:26:54 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508cb65-8874-4797-9d1d-02ef0e0fc439]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:26:54 user nova-compute[75340]: No targets found.
Nov 30 09:26:54 user nova-compute[75340]: iSNS:
Nov 30 09:26:54 user nova-compute[75340]: No targets found.
Nov 30 09:26:54 user nova-compute[75340]: STATIC:
Nov 30 09:26:54 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:26:54 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:54 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:54 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:26:54 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:54 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:54 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a
Nov 30 09:26:54 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:54 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:54 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:26:54 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:54 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:54 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:26:54 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:26:54 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:26:54 user nova-compute[75340]: FIRMWARE:
Nov 30 09:26:54 user nova-compute[75340]: No targets found.
Nov 30 09:26:54 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:26:54 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:26:54 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0810fa-1ee6-4b2e-902e-f3b718931edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79342c-1583-4e77-a871-90088b573685]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)
Nov 30 09:26:54 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:26:54 user nova-compute[75340]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a (non-flash)
Nov 30 09:26:54 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff511069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:26:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2cdc2-fc59-45e3-9a00-891f39b46df2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bffb13-17a2-4c67-8a4b-3ed18175b3f2]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc24a888-0bd5-4c8b-b835-6999e372ff1e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[96790101-1a69-461a-951f-46a9fe46799d]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c8a7d-22f6-45f2-b726-f19049cb7379]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef15121-b94a-436f-a176-c26abbb00b2d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260]
Nov 30 09:26:55 user nova-compute[75340]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a, portal: 172.16.0.220,3260] successful.
Nov 30 09:26:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f881f7c6-9fe0-4ae8-8642-773d7e2c3b9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d076aa-0969-449f-a403-5e7027157db5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] <== disconnect_volume: return (329ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:26:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'flavor' on Instance uuid 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:26:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-076edf6e-e905-47c5-9a8c-917f5da6a659 tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.570s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:26:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:26:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:26:59 user nova-compute[75340]: INFO nova.compute.claims [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Claim successful on node user
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:27:00 user nova-compute[75340]: INFO nova.compute.claims [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Claim successful on node user
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:27:00 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.policy [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '221aef7b87f64a96a9fa77bcec0834ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba97ab8c36f4de8ba045c19af810242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:27:00 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Creating image(s)
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk 1073741824" returned: 0 in 0.055s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:27:01 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Successfully created port: 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.policy [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52476e558c849af9399b952decd75f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2c3d22b4a43208d002d0a7f619c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Cannot resize image /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Ensure instance console log exists: /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:27:01 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Creating image(s)
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "/opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "/opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "/opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.210s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Successfully created port: cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk 1073741824" returned: 0 in 0.089s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Successfully updated port: 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing instance network info cache due to event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Cannot resize image /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Ensure instance console log exists: /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Successfully updated port: cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-changed-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Refreshing instance network info cache due to event network-changed-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] Acquiring lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] Acquired lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Refreshing network info cache for port cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-135faedd-c033-496c-9dfa-2ccf5ced1526 req-2ecd7345-104d-4932-a500-e9ab29225957 service nova] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:02 user nova-compute[75340]: DEBUG nova.network.neutron [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b3b517-7ebb-4fcc-89b6-186e8664a0b6 req-fa988776-6010-4aa2-9958-7674e922810b service nova] Releasing lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquired lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance network_info: |[{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start _get_guest_xml network_info=[{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:27:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578052888',display_name='tempest-ServerRescueNegativeTestJSON-server-578052888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578052888',id=34,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsCBd2ReazykrovKRl1b2E+iXX1BKrpy8UtkoWEeWMTUT+3OykqKpzQehFh0Lv88PF+EODJwGHHO6BFvri7Xw2bmHCLJUAVgmXGerC2B7dAcpxeo2RcivWUDQTMJmnsjQ==',key_name='tempest-keypair-127598941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-lkhvjnx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=28ec2815-8cb8-476b-a830-aab627c77a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:27:03 user nova-compute[75340]:   <uuid>28ec2815-8cb8-476b-a830-aab627c77a14</uuid>
Nov 30 09:27:03 user nova-compute[75340]:   <name>instance-00000022</name>
Nov 30 09:27:03 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:27:03 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:27:03 user nova-compute[75340]:   <metadata>
Nov 30 09:27:03 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:27:03 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578052888</nova:name>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:27:03</nova:creationTime>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:27:03 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:owner>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:owner>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:ports>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:port uuid="99eb1c19-9dbf-45a6-9164-918c020b2c8c">
Nov 30 09:27:03 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:27:03 user nova-compute[75340]:         </nova:port>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:ports>
Nov 30 09:27:03 user nova-compute[75340]:     </nova:instance>
Nov 30 09:27:03 user nova-compute[75340]:   </metadata>
Nov 30 09:27:03 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:27:03 user nova-compute[75340]:     <system>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="serial">28ec2815-8cb8-476b-a830-aab627c77a14</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="uuid">28ec2815-8cb8-476b-a830-aab627c77a14</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:27:03 user nova-compute[75340]:     </system>
Nov 30 09:27:03 user nova-compute[75340]:   </sysinfo>
Nov 30 09:27:03 user nova-compute[75340]:   <os>
Nov 30 09:27:03 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:27:03 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:27:03 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:27:03 user nova-compute[75340]:   </os>
Nov 30 09:27:03 user nova-compute[75340]:   <features>
Nov 30 09:27:03 user nova-compute[75340]:     <acpi/>
Nov 30 09:27:03 user nova-compute[75340]:     <apic/>
Nov 30 09:27:03 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:27:03 user nova-compute[75340]:   </features>
Nov 30 09:27:03 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:27:03 user nova-compute[75340]:   </clock>
Nov 30 09:27:03 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:27:03 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:27:03 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:27:03 user nova-compute[75340]:   </cpu>
Nov 30 09:27:03 user nova-compute[75340]:   <devices>
Nov 30 09:27:03 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:27:03 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:27:03 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk"/>
Nov 30 09:27:03 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:     </disk>
Nov 30 09:27:03 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:27:03 user nova-compute[75340]:       <mac address="fa:16:3e:7f:a8:88"/>
Nov 30 09:27:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:27:03 user nova-compute[75340]:       <target dev="tap99eb1c19-9d"/>
Nov 30 09:27:03 user nova-compute[75340]:     </interface>
Nov 30 09:27:03 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:27:03 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/console.log" append="off"/>
Nov 30 09:27:03 user nova-compute[75340]:     </serial>
Nov 30 09:27:03 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:27:03 user nova-compute[75340]:     <video>
Nov 30 09:27:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:     </video>
Nov 30 09:27:03 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:27:03 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:27:03 user nova-compute[75340]:     </rng>
Nov 30 09:27:03 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:27:03 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:27:03 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:27:03 user nova-compute[75340]:     </memballoon>
Nov 30 09:27:03 user nova-compute[75340]:   </devices>
Nov 30 09:27:03 user nova-compute[75340]: </domain>
Nov 30 09:27:03 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578052888',display_name='tempest-ServerRescueNegativeTestJSON-server-578052888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578052888',id=34,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsCBd2ReazykrovKRl1b2E+iXX1BKrpy8UtkoWEeWMTUT+3OykqKpzQehFh0Lv88PF+EODJwGHHO6BFvri7Xw2bmHCLJUAVgmXGerC2B7dAcpxeo2RcivWUDQTMJmnsjQ==',key_name='tempest-keypair-127598941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-lkhvjnx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=28ec2815-8cb8-476b-a830-aab627c77a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG os_vif [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c27b63f-ccf3-531d-9c28-92f543b213a6', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99eb1c19-9d, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99eb1c19-9d, col_values=(('qos', UUID('59a18d2c-4da3-4279-bf77-6776b64e917c')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99eb1c19-9d, col_values=(('external_ids', {'iface-id': '99eb1c19-9dbf-45a6-9164-918c020b2c8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a8:88', 'vm-uuid': '28ec2815-8cb8-476b-a830-aab627c77a14'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: INFO os_vif [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d')
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.neutron [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updating instance_info_cache with network_info: [{"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Releasing lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance network_info: |[{"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Start _get_guest_xml network_info=[{"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:27:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:7f:a8:88, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1603761008',display_name='tempest-VolumesSnapshotTestJSON-instance-1603761008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1603761008',id=35,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkpEq2XEX1Nld//gAFDIbqHqTuiDeLpeGtnBJXCQISxuG2UlmujCUTkS2/kBrKufwL9Pu4KW7JO7mEaemSUSXIQ0HsKUTD0q3S8Pgd/DMvdIoN8uSxRfoZQUBNUXgtAZQ==',key_name='tempest-keypair-318437605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-yseniah2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=03d69b0b-090c-440f-b615-02574eb5d847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'pci_devices' on Instance uuid 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:27:03 user nova-compute[75340]:   <uuid>03d69b0b-090c-440f-b615-02574eb5d847</uuid>
Nov 30 09:27:03 user nova-compute[75340]:   <name>instance-00000023</name>
Nov 30 09:27:03 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:27:03 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:27:03 user nova-compute[75340]:   <metadata>
Nov 30 09:27:03 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:27:03 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1603761008</nova:name>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:27:03</nova:creationTime>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:27:03 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:owner>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:user uuid="a52476e558c849af9399b952decd75f3">tempest-VolumesSnapshotTestJSON-1914221383-project-member</nova:user>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:project uuid="efd2c3d22b4a43208d002d0a7f619c4b">tempest-VolumesSnapshotTestJSON-1914221383</nova:project>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:owner>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:27:03 user nova-compute[75340]:       <nova:ports>
Nov 30 09:27:03 user nova-compute[75340]:         <nova:port uuid="cb7d4c68-3cf4-4037-8f13-bd48a9314c0a">
Nov 30 09:27:03 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:27:03 user nova-compute[75340]:         </nova:port>
Nov 30 09:27:03 user nova-compute[75340]:       </nova:ports>
Nov 30 09:27:03 user nova-compute[75340]:     </nova:instance>
Nov 30 09:27:03 user nova-compute[75340]:   </metadata>
Nov 30 09:27:03 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:27:03 user nova-compute[75340]:     <system>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="serial">03d69b0b-090c-440f-b615-02574eb5d847</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="uuid">03d69b0b-090c-440f-b615-02574eb5d847</entry>
Nov 30 09:27:03 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:27:03 user nova-compute[75340]:     </system>
Nov 30 09:27:03 user nova-compute[75340]:   </sysinfo>
Nov 30 09:27:03 user nova-compute[75340]:   <os>
Nov 30 09:27:03 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:27:03 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:27:03 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:27:03 user nova-compute[75340]:   </os>
Nov 30 09:27:03 user nova-compute[75340]:   <features>
Nov 30 09:27:03 user nova-compute[75340]:     <acpi/>
Nov 30 09:27:03 user nova-compute[75340]:     <apic/>
Nov 30 09:27:03 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:27:03 user nova-compute[75340]:   </features>
Nov 30 09:27:03 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:27:03 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:27:03 user nova-compute[75340]:   </clock>
Nov 30 09:27:03 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:27:03 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:27:03 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:27:03 user nova-compute[75340]:   </cpu>
Nov 30 09:27:03 user nova-compute[75340]:   <devices>
Nov 30 09:27:03 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:27:03 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:27:03 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk"/>
Nov 30 09:27:03 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:     </disk>
Nov 30 09:27:03 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:27:03 user nova-compute[75340]:       <mac address="fa:16:3e:0f:a2:53"/>
Nov 30 09:27:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:27:03 user nova-compute[75340]:       <target dev="tapcb7d4c68-3c"/>
Nov 30 09:27:03 user nova-compute[75340]:     </interface>
Nov 30 09:27:03 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:27:03 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/console.log" append="off"/>
Nov 30 09:27:03 user nova-compute[75340]:     </serial>
Nov 30 09:27:03 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:27:03 user nova-compute[75340]:     <video>
Nov 30 09:27:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:03 user nova-compute[75340]:     </video>
Nov 30 09:27:03 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:27:03 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:27:03 user nova-compute[75340]:     </rng>
Nov 30 09:27:03 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:27:03 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:27:03 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:27:03 user nova-compute[75340]:     </memballoon>
Nov 30 09:27:03 user nova-compute[75340]:   </devices>
Nov 30 09:27:03 user nova-compute[75340]: </domain>
Nov 30 09:27:03 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1603761008',display_name='tempest-VolumesSnapshotTestJSON-instance-1603761008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1603761008',id=35,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkpEq2XEX1Nld//gAFDIbqHqTuiDeLpeGtnBJXCQISxuG2UlmujCUTkS2/kBrKufwL9Pu4KW7JO7mEaemSUSXIQ0HsKUTD0q3S8Pgd/DMvdIoN8uSxRfoZQUBNUXgtAZQ==',key_name='tempest-keypair-318437605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-yseniah2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=03d69b0b-090c-440f-b615-02574eb5d847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG os_vif [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd4422d9-41db-569d-895d-130b843addd6', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb7d4c68-3c, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb7d4c68-3c, col_values=(('qos', UUID('e097f98f-fed3-4e05-a9f7-6df50aebc1ac')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb7d4c68-3c, col_values=(('external_ids', {'iface-id': 'cb7d4c68-3cf4-4037-8f13-bd48a9314c0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a2:53', 'vm-uuid': '03d69b0b-090c-440f-b615-02574eb5d847'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:03 user nova-compute[75340]: INFO os_vif [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c')
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No VIF found with MAC fa:16:3e:0f:a2:53, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:06 user nova-compute[75340]: WARNING nova.compute.manager [req-cdcb59ee-1b81-4214-ab1a-c6ad491748e8 req-4e02753d-a662-477b-a9f1-5da9c8234da8 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state building and task_state spawning.
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:06 user nova-compute[75340]: INFO nova.compute.manager [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Detaching volume e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: INFO nova.virt.block_device [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Attempting to driver detach volume e5d84218-9418-4cee-b037-f4e84aacca77 from mountpoint /dev/vdb
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Attempting to detach device vdb from instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:27:06 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:06 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:27:06 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:06 user nova-compute[75340]:   <serial>e5d84218-9418-4cee-b037-f4e84aacca77</serial>
Nov 30 09:27:06 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:27:06 user nova-compute[75340]: </disk>
Nov 30 09:27:06 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdb from instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 from the persistent domain config.
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:27:06 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:06 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:27:06 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:06 user nova-compute[75340]:   <serial>e5d84218-9418-4cee-b037-f4e84aacca77</serial>
Nov 30 09:27:06 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:27:06 user nova-compute[75340]: </disk>
Nov 30 09:27:06 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:27:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:08 user nova-compute[75340]: WARNING nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state building and task_state spawning.
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] No waiting events found dispatching network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:08 user nova-compute[75340]: WARNING nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received unexpected event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a for instance with vm_state building and task_state spawning.
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] No waiting events found dispatching network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:08 user nova-compute[75340]: WARNING nova.compute.manager [req-c0d55fab-2a08-4ff0-a550-d81c42e72cc3 req-d513c780-99b6-461a-af66-a4559a9c5c33 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received unexpected event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a for instance with vm_state building and task_state spawning.
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'flavor' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:08 user nova-compute[75340]: INFO nova.compute.manager [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attaching volume 3090dd3f-5708-4ec7-b9f9-3675d34a722f to /dev/vdb
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.utils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398ec2f-757d-4db3-921c-3121369125b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ea1cb-8b5c-4477-acb8-f9b048d8341c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b98405-f2aa-4f2c-9cf3-039f415e0e28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e86c1-5345-468a-9c03-9693b93093e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance spawned successfully.
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:27:08 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:27:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceee73c-9899-4ef3-8193-9e1ebd069376]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG os_brick.utils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating existing volume attachment record: 84a60d6e-ebe0-43fd-9175-6d396ee6629d {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:27:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance spawned successfully.
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:27:09 user nova-compute[75340]: INFO nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Took 8.46 seconds to spawn the instance on the hypervisor.
Nov 30 09:27:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:09 user nova-compute[75340]: INFO nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Took 7.62 seconds to spawn the instance on the hypervisor.
Nov 30 09:27:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:09 user nova-compute[75340]: INFO nova.compute.manager [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Took 9.42 seconds to build instance.
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176a8b53-4b7d-4e66-b55d-b88072e8fc08 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.515s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:09 user nova-compute[75340]: INFO nova.compute.manager [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Took 8.92 seconds to build instance.
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9e4253ad-d253-47cf-825e-2dcddbda812c tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.038s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzKxNySE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:09 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43b4c0-39df-4491-b4df-0ef0d9a21e6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:27:09 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca10496-c095-4f5f-a866-a5e3aae4b89d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77] added
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[95654bae-e7a6-4354-b672-d00018aa5575]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04764b0-4618-4808-b80d-7f7495f48abd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzKxNySE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzKxNySE" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35e4c5-6e06-4b51-9c38-a52e0ec129cf]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mzKxNySE'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca3174-51dc-448e-bfe5-aa6290da2e1c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c5332-59eb-4c13-96cd-9e5dc00ca81e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeaa99f-e7fc-40c4-a2da-e241f31f36d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260]
Nov 30 09:27:10 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260] successful.
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034428e-fb41-4ea9-aa58-586ba36ec1dc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f933e3-e7a3-4b74-ae92-0000a998ce60]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:10 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6e069-20ef-4bec-a310-2cf0cd538a9e]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:27:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzKxNySE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:27:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26366363737663532', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366363737663532', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:27:11 user nova-compute[75340]: DEBUG nova.objects.instance [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:27:11 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:11 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:27:11 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:11 user nova-compute[75340]:   <serial>2ba09a50-a252-4e36-851f-1fce0b87ef77</serial>
Nov 30 09:27:11 user nova-compute[75340]: </disk>
Nov 30 09:27:11 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No VIF found with MAC fa:16:3e:b0:ca:a2, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-316c2b9e-9426-49a8-8f97-0855886499f3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.759s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:12 user nova-compute[75340]: INFO nova.compute.manager [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Terminating instance
Nov 30 09:27:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: INFO nova.compute.manager [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Rescuing
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-unplugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] No waiting events found dispatching network-vif-unplugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6d4d796-52fe-4071-b026-a79601513bea req-bce86a9c-b751-41c6-a52e-fefa07f576dc service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-unplugged-c242fb79-8244-4041-80b3-d0be9d997ba3 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Instance destroyed successfully.
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lazy-loading 'resources' on Instance uuid 9ebc2a6e-23dd-4168-9e95-b959e92e2078 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-564562181',display_name='tempest-VolumesActionsTest-instance-564562181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-564562181',id=32,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-u8ld0gic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:25:30Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=9ebc2a6e-23dd-4168-9e95-b959e92e2078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "c242fb79-8244-4041-80b3-d0be9d997ba3", "address": "fa:16:3e:a0:1b:c4", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc242fb79-82", "ovs_interfaceid": "c242fb79-8244-4041-80b3-d0be9d997ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG os_vif [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc242fb79-82, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0f1519f-7037-4abd-942d-3055e645f199) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:13 user nova-compute[75340]: INFO os_vif [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1b:c4,bridge_name='br-int',has_traffic_filtering=True,id=c242fb79-8244-4041-80b3-d0be9d997ba3,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc242fb79-82')
Nov 30 09:27:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Deleting instance files /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078_del
Nov 30 09:27:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Deletion of /opt/stack/data/nova/instances/9ebc2a6e-23dd-4168-9e95-b959e92e2078_del complete
Nov 30 09:27:13 user nova-compute[75340]: INFO nova.compute.manager [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:14 user nova-compute[75340]: WARNING nova.compute.manager [req-eb1cdd75-b144-4f6b-8856-7538a7bec254 req-212e6b05-426a-4ba2-8eb5-e53f190d3a63 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:14 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:14 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Took 0.95 seconds to deallocate network for instance.
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance destroyed successfully.
Nov 30 09:27:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Attempting a stable device rescue
Nov 30 09:27:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:27:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Creating image(s)
Nov 30 09:27:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] Acquiring lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] No waiting events found dispatching network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received unexpected event network-vif-plugged-c242fb79-8244-4041-80b3-d0be9d997ba3 for instance with vm_state deleted and task_state None.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-5e4c7d7b-d710-40bc-a019-964dcff1a780 req-0d500550-aabf-4859-9d14-254ffea62a8a service nova] [instance: 9ebc2a6e-23dd-4168-9e95-b959e92e2078] Received event network-vif-deleted-c242fb79-8244-4041-80b3-d0be9d997ba3 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.virt.images [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] 24e3bca5-94ea-4924-907f-4d8be4f1b99c was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.part /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: INFO nova.compute.manager [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Detaching volume 2ba09a50-a252-4e36-851f-1fce0b87ef77
Nov 30 09:27:16 user nova-compute[75340]: INFO nova.virt.block_device [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Attempting to driver detach volume 2ba09a50-a252-4e36-851f-1fce0b87ef77 from mountpoint /dev/vdb
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Attempting to detach device vdb from instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:27:16 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:16 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:27:16 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:16 user nova-compute[75340]:   <serial>2ba09a50-a252-4e36-851f-1fce0b87ef77</serial>
Nov 30 09:27:16 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:27:16 user nova-compute[75340]: </disk>
Nov 30 09:27:16 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:16 user nova-compute[75340]: WARNING nova.compute.manager [req-7747fa23-9be9-42e4-bc3d-248071b7d8e0 req-8349f154-0e2b-4d9f-ba23-dc8363bc38c3 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:16 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully detached device vdb from instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 from the persistent domain config.
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:27:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:27:16 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:16 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:27:16 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:16 user nova-compute[75340]:   <serial>2ba09a50-a252-4e36-851f-1fce0b87ef77</serial>
Nov 30 09:27:16 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:27:16 user nova-compute[75340]: </disk>
Nov 30 09:27:16 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.part /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.converted" returned: 0 in 0.497s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.291s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:17 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Deleted allocations for instance 9ebc2a6e-23dd-4168-9e95-b959e92e2078
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.171s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5aa0667c-2c72-4cf1-ae0e-ec15bf3e66ca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "9ebc2a6e-23dd-4168-9e95-b959e92e2078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.563s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb --force-share --output=json" returned: 0 in 0.231s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb,backing_fmt=raw /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb,backing_fmt=raw /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue" returned: 0 in 0.065s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'migration_context' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<0bbdc278-80bc-4c20-87fa-2675a63ea503> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start _get_guest_xml network_info=[{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:3b:d7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '24e3bca5-94ea-4924-907f-4d8be4f1b99c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3f0bde0c-6400-4977-94f3-af684d842f7d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0bbdc278-80bc-4c20-87fa-2675a63ea503', 'attached_at': '', 'detached_at': '', 'volume_id': '950b54c0-8c82-4311-9245-3c8b55279459', 'serial': '950b54c0-8c82-4311-9245-3c8b55279459'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<0bbdc278-80bc-4c20-87fa-2675a63ea503> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<0bbdc278-80bc-4c20-87fa-2675a63ea503> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.objects.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<0bbdc278-80bc-4c20-87fa-2675a63ea503> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:17 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f9079-3bee-48c6-af54-75cef99e647a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MftaXzmW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 09:27:17 user nova-compute[75340]: node.name = iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:27:17 user nova-compute[75340]: node.tpgt = -1
Nov 30 09:27:17 user nova-compute[75340]: node.startup = automatic
Nov 30 09:27:17 user nova-compute[75340]: node.leading_login = No
Nov 30 09:27:17 user nova-compute[75340]: iface.iscsi_ifacename = default
Nov 30 09:27:17 user nova-compute[75340]: iface.net_ifacename = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.ipaddress = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.prefix_len = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.hwaddress = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.transport_name = tcp
Nov 30 09:27:17 user nova-compute[75340]: iface.initiatorname = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.vlan_id = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.vlan_priority = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.vlan_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.iface_num = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.mtu = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.port = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.bootproto = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.subnet_mask = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.gateway = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_alt_client_id = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_dns = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_learn_iqn = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_vendor_id_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_vendor_id = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.dhcp_slp_da = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.fragmentation = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.gratuitous_arp = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.incoming_forwarding = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.tos_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.tos = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.ttl = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.delayed_ack = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.tcp_nagle = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.tcp_wsf_state = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.tcp_wsf = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.tcp_timer_scale = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.tcp_timestamp = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.redirect = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.def_task_mgmt_timeout = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.header_digest = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.data_digest = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.immediate_data = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.initial_r2t = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.data_seq_inorder = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.data_pdu_inorder = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.erl = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.max_receive_data_len = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.first_burst_len = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.max_outstanding_r2t = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.max_burst_len = 0
Nov 30 09:27:17 user nova-compute[75340]: iface.chap_auth = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.bidi_chap = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.strict_login_compliance = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.discovery_auth = <empty>
Nov 30 09:27:17 user nova-compute[75340]: iface.discovery_logout = <empty>
Nov 30 09:27:17 user nova-compute[75340]: node.discovery_address = <empty>
Nov 30 09:27:17 user nova-compute[75340]: node.discovery_port = 0
Nov 30 09:27:17 user nova-compute[75340]: node.discovery_type = static
Nov 30 09:27:17 user nova-compute[75340]: node.session.initial_cmdsn = 0
Nov 30 09:27:17 user nova-compute[75340]: node.session.initial_login_retry_max = 8
Nov 30 09:27:17 user nova-compute[75340]: node.session.xmit_thread_priority = -20
Nov 30 09:27:17 user nova-compute[75340]: node.session.cmds_max = 128
Nov 30 09:27:17 user nova-compute[75340]: node.session.queue_depth = 32
Nov 30 09:27:17 user nova-compute[75340]: node.session.nr_sessions = 1
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.authmethod = CHAP
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.username = MftaXzmW
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.password = ***
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.username_in = <empty>
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.password_in = <empty>
Nov 30 09:27:17 user nova-compute[75340]: node.session.auth.chap_algs = MD5
Nov 30 09:27:17 user nova-compute[75340]: node.session.timeo.replacement_timeout = 120
Nov 30 09:27:17 user nova-compute[75340]: node.session.err_timeo.abort_timeout = 15
Nov 30 09:27:17 user nova-compute[75340]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 09:27:17 user nova-compute[75340]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 09:27:17 user nova-compute[75340]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.FastAbort = Yes
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.InitialR2T = No
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.ImmediateData = Yes
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.MaxConnections = 1
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 09:27:17 user nova-compute[75340]: node.session.iscsi.ERL = 0
Nov 30 09:27:17 user nova-compute[75340]: node.session.scan = manual
Nov 30 09:27:17 user nova-compute[75340]: node.session.reopen_max = 0
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].address = 172.16.0.220
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].port = 3260
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].startup = manual
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].tcp.window_size = 524288
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].tcp.type_of_service = 0
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].timeo.logout_timeout = 15
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].timeo.login_timeout = 15
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].timeo.auth_timeout = 45
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.DataDigest = None
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.IFMarker = No
Nov 30 09:27:17 user nova-compute[75340]: node.conn[0].iscsi.OFMarker = No
Nov 30 09:27:17 user nova-compute[75340]: # END RECORD
Nov 30 09:27:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb2eb4-100e-4ea6-9c63-26eb58ac134a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ccd356-4941-44b6-afbc-5b32c7f67474]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MftaXzmW {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MftaXzmW" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f935e1-76ff-48c0-81a7-6fca50add899]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MftaXzmW'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[16127b1e-1102-4439-92ff-c1b2ffa93c7e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964e03f-99b0-41b2-8412-42c7bc9262fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:17 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] HCTL ('36', '0', '0', 0) found on session 32 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee44225-e60c-4ecb-81e6-ba8d9f1b2f16]: (4, ('0 0 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Searching for a device in session 32 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '26632386565393561', 'path': '/dev/sde'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632386565393561', 'path': '/dev/sde'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1612015618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1612015618',id=31,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9hm7pqmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:50Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=0bbdc278-80bc-4c20-87fa-2675a63ea503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:3b:d7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "vif_mac": "fa:16:3e:3b:d7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.objects.base [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Object Instance<0bbdc278-80bc-4c20-87fa-2675a63ea503> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:27:18 user nova-compute[75340]:   <uuid>0bbdc278-80bc-4c20-87fa-2675a63ea503</uuid>
Nov 30 09:27:18 user nova-compute[75340]:   <name>instance-0000001f</name>
Nov 30 09:27:18 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:27:18 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:27:18 user nova-compute[75340]:   <metadata>
Nov 30 09:27:18 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:27:18 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1612015618</nova:name>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:27:17</nova:creationTime>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:27:18 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:27:18 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:owner>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:user uuid="14f79ef5cc314a3bb971a811a317a5ea">tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member</nova:user>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:project uuid="2e9daa1b03684fb6b29fa66f0f355e47">tempest-ServerBootFromVolumeStableRescueTest-1860517129</nova:project>
Nov 30 09:27:18 user nova-compute[75340]:       </nova:owner>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:27:18 user nova-compute[75340]:       <nova:ports>
Nov 30 09:27:18 user nova-compute[75340]:         <nova:port uuid="a9a06f25-b07d-48e1-979a-2151d4077150">
Nov 30 09:27:18 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 09:27:18 user nova-compute[75340]:         </nova:port>
Nov 30 09:27:18 user nova-compute[75340]:       </nova:ports>
Nov 30 09:27:18 user nova-compute[75340]:     </nova:instance>
Nov 30 09:27:18 user nova-compute[75340]:   </metadata>
Nov 30 09:27:18 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:27:18 user nova-compute[75340]:     <system>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="serial">0bbdc278-80bc-4c20-87fa-2675a63ea503</entry>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="uuid">0bbdc278-80bc-4c20-87fa-2675a63ea503</entry>
Nov 30 09:27:18 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:27:18 user nova-compute[75340]:     </system>
Nov 30 09:27:18 user nova-compute[75340]:   </sysinfo>
Nov 30 09:27:18 user nova-compute[75340]:   <os>
Nov 30 09:27:18 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:27:18 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:27:18 user nova-compute[75340]:   </os>
Nov 30 09:27:18 user nova-compute[75340]:   <features>
Nov 30 09:27:18 user nova-compute[75340]:     <acpi/>
Nov 30 09:27:18 user nova-compute[75340]:     <apic/>
Nov 30 09:27:18 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:27:18 user nova-compute[75340]:   </features>
Nov 30 09:27:18 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:27:18 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:27:18 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:27:18 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:27:18 user nova-compute[75340]:   </clock>
Nov 30 09:27:18 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:27:18 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:27:18 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:27:18 user nova-compute[75340]:   </cpu>
Nov 30 09:27:18 user nova-compute[75340]:   <devices>
Nov 30 09:27:18 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:27:18 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:18 user nova-compute[75340]:       <source dev="/dev/sde"/>
Nov 30 09:27:18 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:27:18 user nova-compute[75340]:       <serial>950b54c0-8c82-4311-9245-3c8b55279459</serial>
Nov 30 09:27:18 user nova-compute[75340]:     </disk>
Nov 30 09:27:18 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:27:18 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:27:18 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue"/>
Nov 30 09:27:18 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:27:18 user nova-compute[75340]:       <boot order="1"/>
Nov 30 09:27:18 user nova-compute[75340]:     </disk>
Nov 30 09:27:18 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:27:18 user nova-compute[75340]:       <mac address="fa:16:3e:3b:d7:3c"/>
Nov 30 09:27:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:18 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:27:18 user nova-compute[75340]:       <target dev="tapa9a06f25-b0"/>
Nov 30 09:27:18 user nova-compute[75340]:     </interface>
Nov 30 09:27:18 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:27:18 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/console.log" append="off"/>
Nov 30 09:27:18 user nova-compute[75340]:     </serial>
Nov 30 09:27:18 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:27:18 user nova-compute[75340]:     <video>
Nov 30 09:27:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:18 user nova-compute[75340]:     </video>
Nov 30 09:27:18 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:27:18 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:27:18 user nova-compute[75340]:     </rng>
Nov 30 09:27:18 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:27:18 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:27:18 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:27:18 user nova-compute[75340]:     </memballoon>
Nov 30 09:27:18 user nova-compute[75340]:   </devices>
Nov 30 09:27:18 user nova-compute[75340]: </domain>
Nov 30 09:27:18 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:27:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance destroyed successfully.
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] No VIF found with MAC fa:16:3e:3b:d7:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:19 user nova-compute[75340]: WARNING nova.compute.manager [req-c4b88112-1e4b-4853-9006-58786f188ee0 req-7593eafc-91d7-4632-a940-de402b77f69a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:20 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:20 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:20 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd49ebb-f377-4823-8c01-e927cafbe59c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:27:20 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4922c03-f4d5-482c-a9ab-f25fededadf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f] added
Nov 30 09:27:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.159s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c81535-9da8-4bf7-b695-c7ba24996a65]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.088s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46bdb97-e322-4f41-bc54-0d25fca5b5af]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUSZcRgd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUSZcRgd" returned: 0 in 0.064s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af9c96a-adb1-4351-8f38-47fca9b55ec4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUSZcRgd'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ac473-37f3-45af-889b-893b45fa5b13]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a226336-b55d-4d4f-8077-31039628b81a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:20 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9303e3f8-f99b-4242-9cb5-aa92d328be11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260]
Nov 30 09:27:20 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260] successful.
Nov 30 09:27:20 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c601ec1c-177c-48f4-8232-ea011fe045be]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[158354eb-da02-4138-97e4-a4148a5f6a32]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:21 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.714s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c327bca5-b792-45e9-a76b-746eb23a13ce]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:21 user nova-compute[75340]: WARNING nova.compute.manager [req-8525e3e5-229a-4753-98a0-aa0a5dccaaf7 req-50c7619c-c1ea-4b44-aab1-24699dfd483e service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c426323d-a226-477b-b308-801236cf0a9e tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.759s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] <== connect_volume: return (1760ms) {'type': 'block', 'scsi_wwn': '23863333632626662', 'path': '/dev/sdg'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333632626662', 'path': '/dev/sdg'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'flavor' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:27:22 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:22 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:27:22 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:27:22 user nova-compute[75340]:   <serial>3090dd3f-5708-4ec7-b9f9-3675d34a722f</serial>
Nov 30 09:27:22 user nova-compute[75340]: </disk>
Nov 30 09:27:22 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No VIF found with MAC fa:16:3e:72:7a:1b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c68d0cde-0f5b-4dde-ad17-c8b49229babd tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.115s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:23 user nova-compute[75340]: INFO nova.compute.manager [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Rescuing
Nov 30 09:27:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:24 user nova-compute[75340]: WARNING nova.compute.manager [req-a0a28b45-10ae-4a5d-8581-e3730b0a4b1f req-64d70845-106e-4d9e-81a7-bf8d36c3f9f1 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:24 user nova-compute[75340]: INFO nova.compute.manager [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Terminating instance
Nov 30 09:27:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:27:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance destroyed successfully.
Nov 30 09:27:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attempting a stable device rescue
Nov 30 09:27:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:27:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Creating image(s)
Nov 30 09:27:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'trusted_certs' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Instance destroyed successfully.
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.objects.instance [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lazy-loading 'resources' on Instance uuid 77d012c3-c534-4719-b2fd-b005e7c261b0 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056260454',display_name='tempest-AttachVolumeNegativeTest-server-2056260454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056260454',id=29,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe98W4FJFX+J8gqY/PvTf0wOdGnz8ll//xfaBbCla2ejnUVolNzFkYr9zQuJVrE/5DDcXPHcwbEZn5zdP1Lv5eGn5GySV5Dh/xr55u88bMjkLLwftu5YQbYzfSJYxaojA==',key_name='tempest-keypair-634148261',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddb2f89853f41d08fbeb37811d9d4e8',ramdisk_id='',reservation_id='r-q6598jnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-689840258',owner_user_name='tempest-AttachVolumeNegativeTest-689840258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea3a2d5bc1c47ea988021ed23683f08',uuid=77d012c3-c534-4719-b2fd-b005e7c261b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converting VIF {"id": "860cb801-a71f-4e38-b3e8-417c78835694", "address": "fa:16:3e:9c:82:90", "network": {"id": "214535a9-92b2-4f9e-9c32-5add7e4a8e43", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-326397593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddb2f89853f41d08fbeb37811d9d4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860cb801-a7", "ovs_interfaceid": "860cb801-a71f-4e38-b3e8-417c78835694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG os_vif [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap860cb801-a7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=409bfabe-2e7a-400d-8408-893e5bc7356f) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:26 user nova-compute[75340]: INFO os_vif [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:82:90,bridge_name='br-int',has_traffic_filtering=True,id=860cb801-a71f-4e38-b3e8-417c78835694,network=Network(214535a9-92b2-4f9e-9c32-5add7e4a8e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860cb801-a7')
Nov 30 09:27:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Deleting instance files /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0_del
Nov 30 09:27:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Deletion of /opt/stack/data/nova/instances/77d012c3-c534-4719-b2fd-b005e7c261b0_del complete
Nov 30 09:27:26 user nova-compute[75340]: INFO nova.compute.manager [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.virt.images [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] 11db30c3-9e51-421a-99b2-9c7e3d6df1cd was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.part /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:26 user nova-compute[75340]: WARNING nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-unplugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] No waiting events found dispatching network-vif-unplugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-unplugged-860cb801-a71f-4e38-b3e8-417c78835694 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Acquiring lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] No waiting events found dispatching network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:26 user nova-compute[75340]: WARNING nova.compute.manager [req-f4b97574-bd32-40dd-9692-7a3f9fc97070 req-95ce9674-ffd1-4be8-80f5-8c12c1244f66 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received unexpected event network-vif-plugged-860cb801-a71f-4e38-b3e8-417c78835694 for instance with vm_state active and task_state deleting.
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.part /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.converted" returned: 0 in 0.443s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.848s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e,backing_fmt=raw /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e,backing_fmt=raw /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue" returned: 0 in 0.067s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "05bee06a152ef3b0bcf4498f6ac30d47d193056e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'migration_context' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Object Instance<be9c04f6-a829-40a7-90aa-9de247e82875> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start _get_guest_xml network_info=[{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "vif_mac": "fa:16:3e:72:7a:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '11db30c3-9e51-421a-99b2-9c7e3d6df1cd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '84a60d6e-ebe0-43fd-9175-6d396ee6629d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'be9c04f6-a829-40a7-90aa-9de247e82875', 'attached_at': '', 'detached_at': '', 'volume_id': '3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'serial': '3090dd3f-5708-4ec7-b9f9-3675d34a722f'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'resources' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:27 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Took 0.98 seconds to deallocate network for instance.
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Object Instance<be9c04f6-a829-40a7-90aa-9de247e82875> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'numa_topology' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Object Instance<be9c04f6-a829-40a7-90aa-9de247e82875> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'vcpu_model' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Object Instance<be9c04f6-a829-40a7-90aa-9de247e82875> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:27 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:27:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 is timed out.
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdb from instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 from the live domain config.
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owAkBWUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3ba1f-455d-4cfb-9a7c-61c3b1f245ab]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uUSZcRgd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 09:27:27 user nova-compute[75340]: node.name = iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:27:27 user nova-compute[75340]: node.tpgt = -1
Nov 30 09:27:27 user nova-compute[75340]: node.startup = automatic
Nov 30 09:27:27 user nova-compute[75340]: node.leading_login = No
Nov 30 09:27:27 user nova-compute[75340]: iface.iscsi_ifacename = default
Nov 30 09:27:27 user nova-compute[75340]: iface.net_ifacename = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.ipaddress = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.prefix_len = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.hwaddress = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.transport_name = tcp
Nov 30 09:27:27 user nova-compute[75340]: iface.initiatorname = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.vlan_id = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.vlan_priority = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.vlan_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.iface_num = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.mtu = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.port = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.bootproto = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.subnet_mask = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.gateway = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_alt_client_id = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_dns = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_learn_iqn = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_vendor_id_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_vendor_id = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.dhcp_slp_da = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.fragmentation = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.gratuitous_arp = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.incoming_forwarding = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.tos_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.tos = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.ttl = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.delayed_ack = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.tcp_nagle = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.tcp_wsf_state = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.tcp_wsf = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.tcp_timer_scale = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.tcp_timestamp = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.redirect = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.def_task_mgmt_timeout = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.header_digest = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.data_digest = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.immediate_data = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.initial_r2t = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.data_seq_inorder = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.data_pdu_inorder = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.erl = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.max_receive_data_len = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.first_burst_len = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.max_outstanding_r2t = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.max_burst_len = 0
Nov 30 09:27:27 user nova-compute[75340]: iface.chap_auth = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.bidi_chap = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.strict_login_compliance = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.discovery_auth = <empty>
Nov 30 09:27:27 user nova-compute[75340]: iface.discovery_logout = <empty>
Nov 30 09:27:27 user nova-compute[75340]: node.discovery_address = <empty>
Nov 30 09:27:27 user nova-compute[75340]: node.discovery_port = 0
Nov 30 09:27:27 user nova-compute[75340]: node.discovery_type = static
Nov 30 09:27:27 user nova-compute[75340]: node.session.initial_cmdsn = 0
Nov 30 09:27:27 user nova-compute[75340]: node.session.initial_login_retry_max = 8
Nov 30 09:27:27 user nova-compute[75340]: node.session.xmit_thread_priority = -20
Nov 30 09:27:27 user nova-compute[75340]: node.session.cmds_max = 128
Nov 30 09:27:27 user nova-compute[75340]: node.session.queue_depth = 32
Nov 30 09:27:27 user nova-compute[75340]: node.session.nr_sessions = 1
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.authmethod = CHAP
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.username = uUSZcRgd
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.password = ***
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.username_in = <empty>
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.password_in = <empty>
Nov 30 09:27:27 user nova-compute[75340]: node.session.auth.chap_algs = MD5
Nov 30 09:27:27 user nova-compute[75340]: node.session.timeo.replacement_timeout = 120
Nov 30 09:27:27 user nova-compute[75340]: node.session.err_timeo.abort_timeout = 15
Nov 30 09:27:27 user nova-compute[75340]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 09:27:27 user nova-compute[75340]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 09:27:27 user nova-compute[75340]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.FastAbort = Yes
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.InitialR2T = No
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.ImmediateData = Yes
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.MaxConnections = 1
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 09:27:27 user nova-compute[75340]: node.session.iscsi.ERL = 0
Nov 30 09:27:27 user nova-compute[75340]: node.session.scan = manual
Nov 30 09:27:27 user nova-compute[75340]: node.session.reopen_max = 0
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].address = 172.16.0.220
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].port = 3260
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].startup = manual
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].tcp.window_size = 524288
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].tcp.type_of_service = 0
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].timeo.logout_timeout = 15
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].timeo.login_timeout = 15
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].timeo.auth_timeout = 45
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.DataDigest = None
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.IFMarker = No
Nov 30 09:27:27 user nova-compute[75340]: node.conn[0].iscsi.OFMarker = No
Nov 30 09:27:27 user nova-compute[75340]: # END RECORD
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316fbc8-71f2-46dc-bba8-b690595b154e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1bbfdc-9ceb-4d29-8145-3332b73fd632]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUSZcRgd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUSZcRgd" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[316419a5-dcaf-4d73-bd9d-dd568e6bf943]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUSZcRgd'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa49424-0437-4860-9183-4d9aa9dbbe5f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4bf7d8-12e0-4f2e-867e-5203f5c0a768]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] HCTL ('38', '0', '0', 0) found on session 36 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f112b9-9799-4674-8f9a-9979d195daeb]: (4, ('0 0 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Searching for a device in session 36 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '23863333632626662', 'path': '/dev/sdg'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333632626662', 'path': '/dev/sdg'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.189s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00091fc-a438-452b-9e09-5e6fc331d819]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:27:27 user nova-compute[75340]: No targets found.
Nov 30 09:27:27 user nova-compute[75340]: iSNS:
Nov 30 09:27:27 user nova-compute[75340]: No targets found.
Nov 30 09:27:27 user nova-compute[75340]: STATIC:
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77
Nov 30 09:27:27 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:27 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:27 user nova-compute[75340]: FIRMWARE:
Nov 30 09:27:27 user nova-compute[75340]: No targets found.
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:27:27 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:27:27 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343741322',display_name='tempest-ServerStableDeviceRescueTest-server-1343741322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343741322',id=28,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK//0qfgJiAJATINPwpjaLe+8XrtpIroRuzvuqCk3Hbe1RPiMwJph2CAXpAXmLft/ZFSoluxkoSRKCDyp37zwJA1eCdsVckeSk3KzBwxnxelxiViAGU063NTV3weUycR3A==',key_name='tempest-keypair-427914405',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:23:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20c54b843022432bafa59fd390295051',ramdisk_id='',reservation_id='r-yi7ltvaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1657990061',owner_user_name='tempest-ServerStableDeviceRescueTest-1657990061-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0f0a6a4a8584208ad2d68fed45b1690',uuid=be9c04f6-a829-40a7-90aa-9de247e82875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "vif_mac": "fa:16:3e:72:7a:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converting VIF {"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "vif_mac": "fa:16:3e:72:7a:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'pci_devices' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cec9fd-738f-4116-b0c4-e885df6e3eed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.objects.base [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Object Instance<be9c04f6-a829-40a7-90aa-9de247e82875> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:27:27 user nova-compute[75340]:   <uuid>be9c04f6-a829-40a7-90aa-9de247e82875</uuid>
Nov 30 09:27:27 user nova-compute[75340]:   <name>instance-0000001c</name>
Nov 30 09:27:27 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:27:27 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:27:27 user nova-compute[75340]:   <metadata>
Nov 30 09:27:27 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:27:27 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1343741322</nova:name>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:27:27</nova:creationTime>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:27:27 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:27:27 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:owner>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:user uuid="b0f0a6a4a8584208ad2d68fed45b1690">tempest-ServerStableDeviceRescueTest-1657990061-project-member</nova:user>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:project uuid="20c54b843022432bafa59fd390295051">tempest-ServerStableDeviceRescueTest-1657990061</nova:project>
Nov 30 09:27:27 user nova-compute[75340]:       </nova:owner>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:27:27 user nova-compute[75340]:       <nova:ports>
Nov 30 09:27:27 user nova-compute[75340]:         <nova:port uuid="6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7">
Nov 30 09:27:27 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:27:27 user nova-compute[75340]:         </nova:port>
Nov 30 09:27:27 user nova-compute[75340]:       </nova:ports>
Nov 30 09:27:27 user nova-compute[75340]:     </nova:instance>
Nov 30 09:27:27 user nova-compute[75340]:   </metadata>
Nov 30 09:27:27 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:27:27 user nova-compute[75340]:     <system>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="serial">be9c04f6-a829-40a7-90aa-9de247e82875</entry>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="uuid">be9c04f6-a829-40a7-90aa-9de247e82875</entry>
Nov 30 09:27:27 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:27:27 user nova-compute[75340]:     </system>
Nov 30 09:27:27 user nova-compute[75340]:   </sysinfo>
Nov 30 09:27:27 user nova-compute[75340]:   <os>
Nov 30 09:27:27 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:27:27 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:27:27 user nova-compute[75340]:   </os>
Nov 30 09:27:27 user nova-compute[75340]:   <features>
Nov 30 09:27:27 user nova-compute[75340]:     <acpi/>
Nov 30 09:27:27 user nova-compute[75340]:     <apic/>
Nov 30 09:27:27 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:27:27 user nova-compute[75340]:   </features>
Nov 30 09:27:27 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:27:27 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:27:27 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:27:27 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:27:27 user nova-compute[75340]:   </clock>
Nov 30 09:27:27 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:27:27 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:27:27 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:27:27 user nova-compute[75340]:   </cpu>
Nov 30 09:27:27 user nova-compute[75340]:   <devices>
Nov 30 09:27:27 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:27:27 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:27:27 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk"/>
Nov 30 09:27:27 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:27:27 user nova-compute[75340]:     </disk>
Nov 30 09:27:27 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:27:27 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:27:27 user nova-compute[75340]:       <source dev="/dev/sdg"/>
Nov 30 09:27:27 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:27:27 user nova-compute[75340]:       <serial>3090dd3f-5708-4ec7-b9f9-3675d34a722f</serial>
Nov 30 09:27:27 user nova-compute[75340]:     </disk>
Nov 30 09:27:27 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:27:27 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:27:27 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue"/>
Nov 30 09:27:27 user nova-compute[75340]:       <target dev="vdc" bus="virtio"/>
Nov 30 09:27:27 user nova-compute[75340]:       <boot order="1"/>
Nov 30 09:27:27 user nova-compute[75340]:     </disk>
Nov 30 09:27:27 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:27:27 user nova-compute[75340]:       <mac address="fa:16:3e:72:7a:1b"/>
Nov 30 09:27:27 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:27 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:27:27 user nova-compute[75340]:       <target dev="tap6d684f04-c5"/>
Nov 30 09:27:27 user nova-compute[75340]:     </interface>
Nov 30 09:27:27 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:27:27 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/console.log" append="off"/>
Nov 30 09:27:27 user nova-compute[75340]:     </serial>
Nov 30 09:27:27 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:27:27 user nova-compute[75340]:     <video>
Nov 30 09:27:27 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:27:27 user nova-compute[75340]:     </video>
Nov 30 09:27:27 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:27:27 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:27:27 user nova-compute[75340]:     </rng>
Nov 30 09:27:27 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:27:27 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:27:27 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:27:27 user nova-compute[75340]:     </memballoon>
Nov 30 09:27:27 user nova-compute[75340]:   </devices>
Nov 30 09:27:27 user nova-compute[75340]: </domain>
Nov 30 09:27:27 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance destroyed successfully.
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a2dc1-b5d6-4b45-ac87-9fe80a87d5fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:27 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff501272e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f86e37d-9296-455a-920e-3f71691409a5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] No VIF found with MAC fa:16:3e:72:7a:1b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[253529e6-86df-4290-ba03-41a4434d919a]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd0ba93-4c03-4ba7-9feb-bee26ba829b1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013f443-d131-47ff-af57-aecd6146d9c2]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243fcfd-451a-4645-a8d8-afd815e17ddb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd9417f-92ae-46d7-b269-c98a3a82c222]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260]
Nov 30 09:27:27 user nova-compute[75340]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77, portal: 172.16.0.220,3260] successful.
Nov 30 09:27:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d84218-9418-4cee-b037-f4e84aacca77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7d4d3-e423-4e13-80f0-aa89757a5b05]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== disconnect_volume: return (553ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:27:27 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Deleted allocations for instance 77d012c3-c534-4719-b2fd-b005e7c261b0
Nov 30 09:27:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-614773a7-72ed-40a0-9201-77a78878818a tempest-AttachVolumeNegativeTest-689840258 tempest-AttachVolumeNegativeTest-689840258-project-member] Lock "77d012c3-c534-4719-b2fd-b005e7c261b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.153s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-0fefad1c-7207-48a6-80b2-2ac50867921d req-5d65305d-76ac-491d-a458-f36b1f4704b9 service nova] [instance: 77d012c3-c534-4719-b2fd-b005e7c261b0] Received event network-vif-deleted-860cb801-a71f-4e38-b3e8-417c78835694 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9a2aa592-2adb-4128-b21f-85f9790e23a3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.153s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75340) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:30 user nova-compute[75340]: WARNING nova.compute.manager [req-65b0e548-4849-43a6-b7b5-ba81763d4619 req-be8c6c43-728b-48c9-b975-22a0654eca3e service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state active and task_state powering-off.
Nov 30 09:27:30 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance destroyed successfully.
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a45d1b4e-e087-4d26-82bd-115be2291851 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.866s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:30 user nova-compute[75340]: WARNING nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:30 user nova-compute[75340]: WARNING nova.compute.manager [req-2ab23683-9057-46c6-a678-42b70afa8564 req-a24b322d-6f77-4300-a972-f172c0f39f45 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state active and task_state rescuing.
Nov 30 09:27:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a3c5803a-c81f-4db2-bb1e-c8a7c086ef4e tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:27:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:32 user nova-compute[75340]: WARNING nova.compute.manager [req-124c5422-a59c-4026-80a5-40a8babc8ab5 req-9e4fb15b-233e-47ef-b440-7e091fbad141 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state None.
Nov 30 09:27:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:37 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 is timed out.
Nov 30 09:27:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully detached device vdb from instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 from the live domain config.
Nov 30 09:27:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzKxNySE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bcd0ce-75ca-478e-bad1-73fb820bfe43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:27:37 user nova-compute[75340]: No targets found.
Nov 30 09:27:37 user nova-compute[75340]: iSNS:
Nov 30 09:27:37 user nova-compute[75340]: No targets found.
Nov 30 09:27:37 user nova-compute[75340]: STATIC:
Nov 30 09:27:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:27:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:27:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:27:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:27:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77
Nov 30 09:27:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:37 user nova-compute[75340]: FIRMWARE:
Nov 30 09:27:37 user nova-compute[75340]: No targets found.
Nov 30 09:27:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:27:37 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:27:37 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4984ba29-85cd-4bf6-b8ae-9e17a9fcbc12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea27568-8d73-46f8-a57c-bad506d06e04]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 (non-flash)
Nov 30 09:27:37 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305a0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd76f6-eca4-4147-b8c6-de472cc9fc98]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073aabb-e1b2-46b1-b332-afb99352514b]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b305854-1507-42b3-8449-07129b5c01bb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce175064-4fce-4be6-ad56-529b095e0b2f]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deac60a-a99d-414b-afc7-590695cb3e80]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc7cc7e-ba4e-43bb-8a93-61a14a9c9fff]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260]
Nov 30 09:27:37 user nova-compute[75340]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77, portal: 172.16.0.220,3260] successful.
Nov 30 09:27:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba09a50-a252-4e36-851f-1fce0b87ef77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e55517-06a2-40c4-8f77-e89ddcc5517c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== disconnect_volume: return (346ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:27:38 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:27:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:39 user nova-compute[75340]: DEBUG nova.objects.instance [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:27:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-176ecfc6-1f85-4b2d-9683-738ccaa42ea3 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.132s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:27:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:27:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing instance network info cache due to event network-changed-a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Refreshing network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:47 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated VIF entry in instance network info cache for port a643fa77-0868-48a4-8fa9-0e40ea283e70. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9a5c81f2-41a6-4c5c-8057-b3bb9df57360 req-2dde07d5-60bc-4406-b1d0-46373c7f2cfe service nova] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Stashing vm_state: active {{(pid=75340) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-changed-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Refreshing instance network info cache due to event network-changed-8b41d275-a828-4889-9d37-7ced21f5f610. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Refreshing network info cache for port 8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:27:49 user nova-compute[75340]: INFO nova.compute.claims [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Claim successful on node user
Nov 30 09:27:49 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating resource usage from migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updated VIF entry in instance network info cache for port 8b41d275-a828-4889-9d37-7ced21f5f610. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c648c2f6-0aba-4c4a-bcd0-d7c0ae5fe7c7 req-3e96af3d-78c4-45fd-bdb5-779a468efd68 service nova] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.632s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:49 user nova-compute[75340]: INFO nova.compute.manager [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Migrating
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Starting migrate_disk_and_power_off {{(pid=75340) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:51 user nova-compute[75340]: WARNING nova.compute.manager [req-9ec58e23-c176-4ce5-a684-ae184e6b5ad6 req-809e3e66-21f8-4f18-b283-755ceafb19d3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state active and task_state resize_migrating.
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance destroyed successfully.
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b41d275-a8, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=872de814-05bc-49ec-b001-789569f35c48) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:51 user nova-compute[75340]: INFO os_vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8')
Nov 30 09:27:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:51 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25cb80-99a3-4c03-a8a2-c6390aca14e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:27:51 user nova-compute[75340]: No targets found.
Nov 30 09:27:51 user nova-compute[75340]: iSNS:
Nov 30 09:27:51 user nova-compute[75340]: No targets found.
Nov 30 09:27:51 user nova-compute[75340]: STATIC:
Nov 30 09:27:51 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:27:51 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:51 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:51 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:27:51 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:51 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:51 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:27:51 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:51 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:51 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:27:51 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:27:51 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:27:51 user nova-compute[75340]: FIRMWARE:
Nov 30 09:27:51 user nova-compute[75340]: No targets found.
Nov 30 09:27:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:27:51 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:27:51 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93030d48-f1a2-45c4-8ee4-036f513008bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa31f5b-135c-41f2-b902-1aa03dac6ccb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:27:51 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:27:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50125bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed36ac07-2309-4070-9c18-2440e1d5b5fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feff35a-c470-48e9-8add-483e58aabb01]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c591a256-6353-4aba-9445-d18dc2961721]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c60a07-9eea-4705-80d5-101ea18e1415]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2df7b510', '/dev/disk/by-id/scsi-26665303831653164', '/dev/disk/by-id/scsi-1SCST_BIO2df7b510-fe081e1d9918814e') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238026b-763b-439a-8c95-d627141b33bc]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e65a363-6a78-4d4b-b58d-fc8a2e06114d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad309cd0-9ee1-4b53-8e6a-a85edea2a4f7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]
Nov 30 09:27:51 user nova-compute[75340]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.
Nov 30 09:27:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd467bb-e49c-43f7-b802-907d91d2b2f1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== disconnect_volume: return (405ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Port 8b41d275-a828-4889-9d37-7ced21f5f610 binding to destination host user is already ACTIVE {{(pid=75340) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:27:53 user nova-compute[75340]: WARNING nova.compute.manager [req-775ed5e9-7319-4d32-8030-82d426d88d42 req-a073eaac-8d29-45d4-8f51-5f01b86118f3 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state active and task_state resize_migrating.
Nov 30 09:27:53 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:53 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7262MB free_disk=24.965316772460938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Applying migration context for instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 as it has an incoming, in-progress migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04. Migration status is post-migrating {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 09:27:53 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating resource usage from migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 03d69b0b-090c-440f-b615-02574eb5d847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:27:53 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.utils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b49b0-d95f-4fca-942e-5fe2cbca6c82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83650268-2833-4864-8d67-55cef1f16f46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8c5e1-12b6-4b1a-bfa8-ecb0b0927742]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b7211-59ac-44fa-89f6-f9aef1a2b538]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:27:54 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:27:54 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dbc405-ccd3-4470-85a9-e96799e6ff36]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:27:54 user nova-compute[75340]: DEBUG os_brick.utils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:27:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:27:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Starting finish_migration {{(pid=75340) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:28:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Creating image(s)
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Ensure instance console log exists: /opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start _get_guest_xml network_info=[{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '0e845099-b499-48c5-8d16-2ee7bc2ced12', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f1271f7f-d3d0-4d07-b9ee-50592fc9de61', 'attached_at': '2023-11-30T09:28:03.000000', 'detached_at': '', 'volume_id': '50a841f5-f0f8-4894-96ab-b144633ccfae', 'serial': '50a841f5-f0f8-4894-96ab-b144633ccfae'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:28:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:28:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:28:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:28:03 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a350732b-50a5-4308-b573-dbe63203c2c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:28:03 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[072d4e1f-7cfb-4408-8024-113c66eb5712]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae] added
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d10f91-2f64-484b-ae3d-e60a0338c147]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d4ef1-2298-42e8-bdf5-6d8f71a9e028]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsbXIrjP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsbXIrjP" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8026450e-7531-4564-8ff7-3cf43b85e99f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsbXIrjP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6b7c8-1a1b-4e3a-a320-e640026776fc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0b796-6412-42f6-b3ad-be8b7e1d66a9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35010bb-de0e-4bf3-ac71-b035630afd38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]
Nov 30 09:28:03 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d886fe-4456-4bd3-9d7f-3b96de5b596e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a70fd9-71a0-4644-b70a-236d0405a0cb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:28:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:28:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70af13d8-f84e-4fcc-bc3b-2a7b53e10c01]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:28:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26665303831653164', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665303831653164', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:28:04 user nova-compute[75340]:   <uuid>f1271f7f-d3d0-4d07-b9ee-50592fc9de61</uuid>
Nov 30 09:28:04 user nova-compute[75340]:   <name>instance-00000021</name>
Nov 30 09:28:04 user nova-compute[75340]:   <memory>2097152</memory>
Nov 30 09:28:04 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:28:04 user nova-compute[75340]:   <metadata>
Nov 30 09:28:04 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:28:04 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:28:04 user nova-compute[75340]:       <nova:name>tempest-ServerActionsTestOtherA-server-290554714</nova:name>
Nov 30 09:28:04 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:28:03</nova:creationTime>
Nov 30 09:28:04 user nova-compute[75340]:       <nova:flavor name="m1.small">
Nov 30 09:28:04 user nova-compute[75340]:         <nova:memory>2048</nova:memory>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:disk>20</nova:disk>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:28:04 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:28:04 user nova-compute[75340]:       <nova:owner>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:user uuid="61fabd845c2a4368bab99d4ca469452a">tempest-ServerActionsTestOtherA-1563000763-project-member</nova:user>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:project uuid="5c2a93601bf545c7b13b34afc2c0da24">tempest-ServerActionsTestOtherA-1563000763</nova:project>
Nov 30 09:28:04 user nova-compute[75340]:       </nova:owner>
Nov 30 09:28:04 user nova-compute[75340]:       <nova:ports>
Nov 30 09:28:04 user nova-compute[75340]:         <nova:port uuid="8b41d275-a828-4889-9d37-7ced21f5f610">
Nov 30 09:28:04 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:28:04 user nova-compute[75340]:         </nova:port>
Nov 30 09:28:04 user nova-compute[75340]:       </nova:ports>
Nov 30 09:28:04 user nova-compute[75340]:     </nova:instance>
Nov 30 09:28:04 user nova-compute[75340]:   </metadata>
Nov 30 09:28:04 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:28:04 user nova-compute[75340]:     <system>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="serial">f1271f7f-d3d0-4d07-b9ee-50592fc9de61</entry>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="uuid">f1271f7f-d3d0-4d07-b9ee-50592fc9de61</entry>
Nov 30 09:28:04 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:28:04 user nova-compute[75340]:     </system>
Nov 30 09:28:04 user nova-compute[75340]:   </sysinfo>
Nov 30 09:28:04 user nova-compute[75340]:   <os>
Nov 30 09:28:04 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:28:04 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:28:04 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:28:04 user nova-compute[75340]:   </os>
Nov 30 09:28:04 user nova-compute[75340]:   <features>
Nov 30 09:28:04 user nova-compute[75340]:     <acpi/>
Nov 30 09:28:04 user nova-compute[75340]:     <apic/>
Nov 30 09:28:04 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:28:04 user nova-compute[75340]:   </features>
Nov 30 09:28:04 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:28:04 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:28:04 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:28:04 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:28:04 user nova-compute[75340]:   </clock>
Nov 30 09:28:04 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:28:04 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:28:04 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:28:04 user nova-compute[75340]:   </cpu>
Nov 30 09:28:04 user nova-compute[75340]:   <devices>
Nov 30 09:28:04 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:28:04 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:28:04 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:28:04 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:28:04 user nova-compute[75340]:       <serial>50a841f5-f0f8-4894-96ab-b144633ccfae</serial>
Nov 30 09:28:04 user nova-compute[75340]:     </disk>
Nov 30 09:28:04 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:28:04 user nova-compute[75340]:       <mac address="fa:16:3e:d9:b2:d8"/>
Nov 30 09:28:04 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:04 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:28:04 user nova-compute[75340]:       <target dev="tap8b41d275-a8"/>
Nov 30 09:28:04 user nova-compute[75340]:     </interface>
Nov 30 09:28:04 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:28:04 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61/console.log" append="off"/>
Nov 30 09:28:04 user nova-compute[75340]:     </serial>
Nov 30 09:28:04 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:28:04 user nova-compute[75340]:     <video>
Nov 30 09:28:04 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:04 user nova-compute[75340]:     </video>
Nov 30 09:28:04 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:28:04 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:28:04 user nova-compute[75340]:     </rng>
Nov 30 09:28:04 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:28:04 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:28:04 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:28:04 user nova-compute[75340]:     </memballoon>
Nov 30 09:28:04 user nova-compute[75340]:   </devices>
Nov 30 09:28:04 user nova-compute[75340]: </domain>
Nov 30 09:28:04 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876055800-network", "vif_mac": "fa:16:3e:d9:b2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG os_vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcaf8572-283c-52b8-b290-f982315f8a0c', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b41d275-a8, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b41d275-a8, col_values=(('qos', UUID('07f05f87-a4d3-446e-85ed-61fd9c333176')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b41d275-a8, col_values=(('external_ids', {'iface-id': '8b41d275-a828-4889-9d37-7ced21f5f610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:b2:d8', 'vm-uuid': 'f1271f7f-d3d0-4d07-b9ee-50592fc9de61'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:04 user nova-compute[75340]: INFO os_vif [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8')
Nov 30 09:28:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:28:04 user nova-compute[75340]: INFO nova.compute.claims [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Claim successful on node user
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:28:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] No VIF found with MAC fa:16:3e:d9:b2:d8, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:28:05 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.policy [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49bf7b06ea4d4c12974e71198ab41be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba603fbafbe4bc6bda4cadaafc64f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:28:05 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Creating image(s)
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "/opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "/opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.250s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk 1073741824" returned: 0 in 0.048s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Successfully created port: 9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:28:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Cannot resize image /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:06 user nova-compute[75340]: WARNING nova.compute.manager [req-763188f9-8e2d-46d5-9638-c4a2495f95c4 req-3aceaa9c-2eb9-4778-87e0-4587f6cdea1e service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state active and task_state resize_finish.
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Successfully updated port: 9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquired lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-changed-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Refreshing instance network info cache due to event network-changed-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] Acquiring lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Updating instance_info_cache with network_info: [{"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Releasing lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Instance network_info: |[{"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] Acquired lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Refreshing network info cache for port 9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Start _get_guest_xml network_info=[{"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:28:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1718600492',display_name='tempest-VolumesActionsTest-instance-1718600492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1718600492',id=36,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-f08qzwgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:28:05Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=5c3289ef-6c16-4296-82f8-173a7cdd3cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c3289ef-6c16-4296-82f8-173a7cdd3cc2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:28:07 user nova-compute[75340]:   <uuid>5c3289ef-6c16-4296-82f8-173a7cdd3cc2</uuid>
Nov 30 09:28:07 user nova-compute[75340]:   <name>instance-00000024</name>
Nov 30 09:28:07 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:28:07 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:28:07 user nova-compute[75340]:   <metadata>
Nov 30 09:28:07 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:28:07 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:name>tempest-VolumesActionsTest-instance-1718600492</nova:name>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:28:07</nova:creationTime>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:28:07 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:28:07 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:owner>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:user uuid="49bf7b06ea4d4c12974e71198ab41be3">tempest-VolumesActionsTest-1790057548-project-member</nova:user>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:project uuid="5ba603fbafbe4bc6bda4cadaafc64f0a">tempest-VolumesActionsTest-1790057548</nova:project>
Nov 30 09:28:07 user nova-compute[75340]:       </nova:owner>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:28:07 user nova-compute[75340]:       <nova:ports>
Nov 30 09:28:07 user nova-compute[75340]:         <nova:port uuid="9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab">
Nov 30 09:28:07 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 09:28:07 user nova-compute[75340]:         </nova:port>
Nov 30 09:28:07 user nova-compute[75340]:       </nova:ports>
Nov 30 09:28:07 user nova-compute[75340]:     </nova:instance>
Nov 30 09:28:07 user nova-compute[75340]:   </metadata>
Nov 30 09:28:07 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:28:07 user nova-compute[75340]:     <system>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="serial">5c3289ef-6c16-4296-82f8-173a7cdd3cc2</entry>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="uuid">5c3289ef-6c16-4296-82f8-173a7cdd3cc2</entry>
Nov 30 09:28:07 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:28:07 user nova-compute[75340]:     </system>
Nov 30 09:28:07 user nova-compute[75340]:   </sysinfo>
Nov 30 09:28:07 user nova-compute[75340]:   <os>
Nov 30 09:28:07 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:28:07 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:28:07 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:28:07 user nova-compute[75340]:   </os>
Nov 30 09:28:07 user nova-compute[75340]:   <features>
Nov 30 09:28:07 user nova-compute[75340]:     <acpi/>
Nov 30 09:28:07 user nova-compute[75340]:     <apic/>
Nov 30 09:28:07 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:28:07 user nova-compute[75340]:   </features>
Nov 30 09:28:07 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:28:07 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:28:07 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:28:07 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:28:07 user nova-compute[75340]:   </clock>
Nov 30 09:28:07 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:28:07 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:28:07 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:28:07 user nova-compute[75340]:   </cpu>
Nov 30 09:28:07 user nova-compute[75340]:   <devices>
Nov 30 09:28:07 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:28:07 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:28:07 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk"/>
Nov 30 09:28:07 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:28:07 user nova-compute[75340]:     </disk>
Nov 30 09:28:07 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:28:07 user nova-compute[75340]:       <mac address="fa:16:3e:17:4f:2a"/>
Nov 30 09:28:07 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:07 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:28:07 user nova-compute[75340]:       <target dev="tap9f31ea8b-3d"/>
Nov 30 09:28:07 user nova-compute[75340]:     </interface>
Nov 30 09:28:07 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:28:07 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/console.log" append="off"/>
Nov 30 09:28:07 user nova-compute[75340]:     </serial>
Nov 30 09:28:07 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:28:07 user nova-compute[75340]:     <video>
Nov 30 09:28:07 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:07 user nova-compute[75340]:     </video>
Nov 30 09:28:07 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:28:07 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:28:07 user nova-compute[75340]:     </rng>
Nov 30 09:28:07 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:28:07 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:28:07 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:28:07 user nova-compute[75340]:     </memballoon>
Nov 30 09:28:07 user nova-compute[75340]:   </devices>
Nov 30 09:28:07 user nova-compute[75340]: </domain>
Nov 30 09:28:07 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1718600492',display_name='tempest-VolumesActionsTest-instance-1718600492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1718600492',id=36,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-f08qzwgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:28:05Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=5c3289ef-6c16-4296-82f8-173a7cdd3cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG os_vif [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '551867f5-cd19-57f1-8342-53259f1d2584', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f31ea8b-3d, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f31ea8b-3d, col_values=(('qos', UUID('fe4e49f7-faa2-4233-add0-6943dbbf49df')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f31ea8b-3d, col_values=(('external_ids', {'iface-id': '9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4f:2a', 'vm-uuid': '5c3289ef-6c16-4296-82f8-173a7cdd3cc2'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:07 user nova-compute[75340]: INFO os_vif [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d')
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] No VIF found with MAC fa:16:3e:17:4f:2a, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Updated VIF entry in instance network info cache for port 9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG nova.network.neutron [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Updating instance_info_cache with network_info: [{"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56361d85-df08-45f4-91e5-d6b4e044478e req-59021851-42dd-4030-a24f-571b8310ddcf service nova] Releasing lock "refresh_cache-5c3289ef-6c16-4296-82f8-173a7cdd3cc2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:28:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance running successfully.
Nov 30 09:28:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Failed to set time: agent not configured {{(pid=75340) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c9ca5c04-ee66-47ea-80c7-fc26f9461dd2 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] finish_migration finished successfully. {{(pid=75340) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:08 user nova-compute[75340]: WARNING nova.compute.manager [req-4f741db5-2d32-43d0-bdc2-629afd913811 req-e155535b-046e-40b1-8607-5af0770802a7 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state resized and task_state None.
Nov 30 09:28:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] No waiting events found dispatching network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:09 user nova-compute[75340]: WARNING nova.compute.manager [req-bac8c496-9b91-43c9-9d0b-74dcfbf52417 req-46cf6276-34bf-4191-91e4-f6933598bc9f service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received unexpected event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab for instance with vm_state building and task_state spawning.
Nov 30 09:28:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:28:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:28:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Instance spawned successfully.
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.compute.manager [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] No waiting events found dispatching network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:11 user nova-compute[75340]: WARNING nova.compute.manager [req-29ac521c-2d78-4abf-b4f2-5b62c1778a57 req-b773a06a-c18d-4152-9c57-5a06233c4060 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received unexpected event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab for instance with vm_state building and task_state spawning.
Nov 30 09:28:11 user nova-compute[75340]: INFO nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:28:11 user nova-compute[75340]: INFO nova.compute.manager [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Took 6.67 seconds to build instance.
Nov 30 09:28:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f749558b-cba2-4148-a6f1-348aed494eca tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.797s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:28:11 user nova-compute[75340]: INFO nova.compute.manager [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] instance snapshotting
Nov 30 09:28:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Beginning live snapshot process
Nov 30 09:28:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json -f qcow2 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863.delta 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863.delta 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 09:28:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:28:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] COPY block job progress, current cursor: 26935296 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:28:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75340) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 09:28:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 09:28:14 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:28:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863.delta /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863.delta /opt/stack/data/nova/instances/snapshots/tmpme5hd8vv/3e1926744f014e769960a5d1dedfa863" returned: 0 in 0.538s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Snapshot extracted, beginning image upload
Nov 30 09:28:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Snapshot image upload complete
Nov 30 09:28:17 user nova-compute[75340]: INFO nova.compute.manager [None req-0f27cea3-c51a-4da2-aced-5e05ae8e41ff tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Took 6.31 seconds to snapshot the instance on the hypervisor.
Nov 30 09:28:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:28:20 user nova-compute[75340]: INFO nova.compute.claims [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Claim successful on node user
Nov 30 09:28:20 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:28:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.policy [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a38f18b22334b9a94fbaebca2b89798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113c291d956c434983f43ee4c9d85211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:28:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Creating image(s)
Nov 30 09:28:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "/opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "/opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "/opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "ba06f4d92d6be6cd7a0534492459435756dd825a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "ba06f4d92d6be6cd7a0534492459435756dd825a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Successfully created port: d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.part --force-share --output=json" returned: 0 in 0.242s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG nova.virt.images [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] 68802743-2aa5-4814-9715-3ea9218e770a was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.part /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.part /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.converted" returned: 0 in 0.281s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "ba06f4d92d6be6cd7a0534492459435756dd825a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.765s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Successfully updated port: d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquired lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-changed-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing instance network info cache due to event network-changed-d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] Acquiring lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "ba06f4d92d6be6cd7a0534492459435756dd825a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "ba06f4d92d6be6cd7a0534492459435756dd825a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a,backing_fmt=raw /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a,backing_fmt=raw /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk 1073741824" returned: 0 in 0.052s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "ba06f4d92d6be6cd7a0534492459435756dd825a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating instance_info_cache with network_info: [{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Releasing lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance network_info: |[{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] Acquired lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing network info cache for port d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Ensure instance console log exists: /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Start _get_guest_xml network_info=[{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6067cce271a349ec0b624aed80fe51da',container_format='bare',created_at=2023-11-30T09:28:11Z,direct_url=<?>,disk_format='qcow2',id=68802743-2aa5-4814-9715-3ea9218e770a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1977749971',owner='113c291d956c434983f43ee4c9d85211',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T09:28:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '68802743-2aa5-4814-9715-3ea9218e770a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:28:23 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:23 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6067cce271a349ec0b624aed80fe51da',container_format='bare',created_at=2023-11-30T09:28:11Z,direct_url=<?>,disk_format='qcow2',id=68802743-2aa5-4814-9715-3ea9218e770a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1977749971',owner='113c291d956c434983f43ee4c9d85211',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T09:28:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-802808527',display_name='tempest-TestStampPattern-server-802808527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-802808527',id=37,image_ref='68802743-2aa5-4814-9715-3ea9218e770a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-bbhlr00b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='80eb22f8-9079-4cbe-8601-14a994c0b2e6',image_min_disk='1',image_min_ram='0',image_owner_id='113c291d956c434983f43ee4c9d85211',image_owner_project_name='tempest-TestStampPattern-30718589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-30718589-project-member',image_user_id='9a38f18b22334b9a94fbaebca2b89798',network_allocated='True',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:28:21Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=308ab353-749a-464b-affe-811f4292a492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.objects.instance [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'pci_devices' on Instance uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:28:23 user nova-compute[75340]:   <uuid>308ab353-749a-464b-affe-811f4292a492</uuid>
Nov 30 09:28:23 user nova-compute[75340]:   <name>instance-00000025</name>
Nov 30 09:28:23 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:28:23 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:28:23 user nova-compute[75340]:   <metadata>
Nov 30 09:28:23 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:28:23 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:name>tempest-TestStampPattern-server-802808527</nova:name>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:28:23</nova:creationTime>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:28:23 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:28:23 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:owner>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:user uuid="9a38f18b22334b9a94fbaebca2b89798">tempest-TestStampPattern-30718589-project-member</nova:user>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:project uuid="113c291d956c434983f43ee4c9d85211">tempest-TestStampPattern-30718589</nova:project>
Nov 30 09:28:23 user nova-compute[75340]:       </nova:owner>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:root type="image" uuid="68802743-2aa5-4814-9715-3ea9218e770a"/>
Nov 30 09:28:23 user nova-compute[75340]:       <nova:ports>
Nov 30 09:28:23 user nova-compute[75340]:         <nova:port uuid="d5808db1-a754-4fba-9767-485331d29836">
Nov 30 09:28:23 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 09:28:23 user nova-compute[75340]:         </nova:port>
Nov 30 09:28:23 user nova-compute[75340]:       </nova:ports>
Nov 30 09:28:23 user nova-compute[75340]:     </nova:instance>
Nov 30 09:28:23 user nova-compute[75340]:   </metadata>
Nov 30 09:28:23 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:28:23 user nova-compute[75340]:     <system>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="serial">308ab353-749a-464b-affe-811f4292a492</entry>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="uuid">308ab353-749a-464b-affe-811f4292a492</entry>
Nov 30 09:28:23 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:28:23 user nova-compute[75340]:     </system>
Nov 30 09:28:23 user nova-compute[75340]:   </sysinfo>
Nov 30 09:28:23 user nova-compute[75340]:   <os>
Nov 30 09:28:23 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:28:23 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:28:23 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:28:23 user nova-compute[75340]:   </os>
Nov 30 09:28:23 user nova-compute[75340]:   <features>
Nov 30 09:28:23 user nova-compute[75340]:     <acpi/>
Nov 30 09:28:23 user nova-compute[75340]:     <apic/>
Nov 30 09:28:23 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:28:23 user nova-compute[75340]:   </features>
Nov 30 09:28:23 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:28:23 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:28:23 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:28:23 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:28:23 user nova-compute[75340]:   </clock>
Nov 30 09:28:23 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:28:23 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:28:23 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:28:23 user nova-compute[75340]:   </cpu>
Nov 30 09:28:23 user nova-compute[75340]:   <devices>
Nov 30 09:28:23 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:28:23 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:28:23 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk"/>
Nov 30 09:28:23 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:28:23 user nova-compute[75340]:     </disk>
Nov 30 09:28:23 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:28:23 user nova-compute[75340]:       <mac address="fa:16:3e:dd:0f:27"/>
Nov 30 09:28:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:23 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:28:23 user nova-compute[75340]:       <target dev="tapd5808db1-a7"/>
Nov 30 09:28:23 user nova-compute[75340]:     </interface>
Nov 30 09:28:23 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:28:23 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/console.log" append="off"/>
Nov 30 09:28:23 user nova-compute[75340]:     </serial>
Nov 30 09:28:23 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:28:23 user nova-compute[75340]:     <video>
Nov 30 09:28:23 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:28:23 user nova-compute[75340]:     </video>
Nov 30 09:28:23 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:28:23 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:28:23 user nova-compute[75340]:     </rng>
Nov 30 09:28:23 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:28:23 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:28:23 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:28:23 user nova-compute[75340]:     </memballoon>
Nov 30 09:28:23 user nova-compute[75340]:   </devices>
Nov 30 09:28:23 user nova-compute[75340]: </domain>
Nov 30 09:28:23 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-802808527',display_name='tempest-TestStampPattern-server-802808527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-802808527',id=37,image_ref='68802743-2aa5-4814-9715-3ea9218e770a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-bbhlr00b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='80eb22f8-9079-4cbe-8601-14a994c0b2e6',image_min_disk='1',image_min_ram='0',image_owner_id='113c291d956c434983f43ee4c9d85211',image_owner_project_name='tempest-TestStampPattern-30718589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-30718589-project-member',image_user_id='9a38f18b22334b9a94fbaebca2b89798',network_allocated='True',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:28:21Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=308ab353-749a-464b-affe-811f4292a492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG os_vif [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47ee476-12ff-561c-87a8-997f9c5c6f05', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5808db1-a7, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5808db1-a7, col_values=(('qos', UUID('2801cf0a-7a72-4b49-8ae9-cdb91ee01544')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5808db1-a7, col_values=(('external_ids', {'iface-id': 'd5808db1-a754-4fba-9767-485331d29836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:0f:27', 'vm-uuid': '308ab353-749a-464b-affe-811f4292a492'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:23 user nova-compute[75340]: INFO os_vif [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7')
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No VIF found with MAC fa:16:3e:dd:0f:27, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:28:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:24 user nova-compute[75340]: DEBUG nova.network.neutron [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updated VIF entry in instance network info cache for port d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:28:24 user nova-compute[75340]: DEBUG nova.network.neutron [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating instance_info_cache with network_info: [{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9dae7c6b-1024-465c-900d-faeb183234bf req-cd48b059-44d2-49d1-aecb-9e9f0c0bad63 service nova] Releasing lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] Acquiring lock "308ab353-749a-464b-affe-811f4292a492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG nova.compute.manager [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] No waiting events found dispatching network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:25 user nova-compute[75340]: WARNING nova.compute.manager [req-367852a3-715d-4311-a10c-48c26655e6ec req-4457a963-83ea-4af3-82ca-6afe694671ea service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received unexpected event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 for instance with vm_state building and task_state spawning.
Nov 30 09:28:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:28:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance spawned successfully.
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.compute.manager [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] Acquiring lock "308ab353-749a-464b-affe-811f4292a492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.compute.manager [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] No waiting events found dispatching network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:28:27 user nova-compute[75340]: WARNING nova.compute.manager [req-b0786dad-fddb-47c2-ac80-bf17825fecb1 req-b5f35ca7-c1fc-48e4-8f45-74969fdfd192 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received unexpected event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 for instance with vm_state building and task_state spawning.
Nov 30 09:28:27 user nova-compute[75340]: INFO nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 30 09:28:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:28:28 user nova-compute[75340]: INFO nova.compute.manager [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Took 7.68 seconds to build instance.
Nov 30 09:28:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fe2b0c7b-72e0-475b-bc99-4220a974a3cd tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.794s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:28:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:28:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing instance network info cache due to event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'flavor' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:51 user nova-compute[75340]: INFO nova.compute.manager [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Attaching volume e360513f-76a7-473f-9de9-76766af24a8d to /dev/vdb
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cfd858-52eb-46d9-aeb2-89e513034856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecfd721-95af-4a0e-b5c3-4804673f7328]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4ba20-0475-40f0-8f89-a01d3495e0dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec00ee-52d3-4d71-a4bf-bb1a1caea814]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:28:51 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf854839-0775-4ad6-bca6-522c4959d127]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating existing volume attachment record: bcd6b005-5bdb-4cd4-bbed-b1bd87b20dd5 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-changed-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Refreshing instance network info cache due to event network-changed-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] Acquiring lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] Acquired lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Refreshing network info cache for port cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updated VIF entry in instance network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e5715b33-401b-4de3-9150-9367089fad95 req-403277e8-9d8a-47c5-940c-ec7d24bdd185 service nova] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:28:52 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Ignoring supplied device name: /dev/vdb
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updated VIF entry in instance network info cache for port cb7d4c68-3cf4-4037-8f13-bd48a9314c0a. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updating instance_info_cache with network_info: [{"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4ccae7dc-cb03-45c0-82c2-b4f75a7660dd req-2a53e72f-54e3-4d05-a5bf-3d63d44f280c service nova] Releasing lock "refresh_cache-03d69b0b-090c-440f-b615-02574eb5d847" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:52 user nova-compute[75340]: INFO nova.compute.manager [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Attaching volume 158cc9a0-1135-4815-9f1d-6ec2c493e7f6 to /dev/vdb
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.utils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69ae7a-5b7c-412c-a208-c743dde240b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b88199-d7e5-4587-a3f3-e274e0fdb8f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f36cb5-2cf4-493b-8850-2348c978cfa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84478ab0-42e7-4041-883f-f1c5cdbefad4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:28:52 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59600c-05ab-45a7-89da-e40dae75991a]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG os_brick.utils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updating existing volume attachment record: b2139563-ea32-4cb7-b3cd-e480a9c0ce6a {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:28:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=6997MB free_disk=24.77922821044922GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Applying migration context for instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 as it has an incoming, in-progress migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04. Migration status is finished {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 09:28:55 user nova-compute[75340]: INFO nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating resource usage from migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 03d69b0b-090c-440f-b615-02574eb5d847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 5c3289ef-6c16-4296-82f8-173a7cdd3cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 308ab353-749a-464b-affe-811f4292a492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:28:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:28:56 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:28:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:28:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:28:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:28:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:28:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqdAHQpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:29:02 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:02 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:02 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c1b38-539b-42a8-b149-c557a9602160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:29:02 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0919607c-eded-431c-af2c-4ca4abbfe2f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6] added
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330cd5a-a479-41a4-8f4a-88e46cbdb415]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b08012-5557-4b61-b550-8832aaff9fff]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqdAHQpC {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqdAHQpC" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc816e-4592-4109-80c9-8f664a0e52c8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqdAHQpC'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe73b086-c7a4-4dc6-9f35-1084cbcb531e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290e148-0006-473b-adaa-f397c16878d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[505fa9e1-c5df-4e34-9379-287726b53e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260]
Nov 30 09:29:02 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260] successful.
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bc7ff7-fd0a-4260-a2d8-28a709ca8466]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eebcfd1-385d-4cb4-8d61-b7a37b80fac5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:02 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.126s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c9ada8-abe6-4939-a724-79e10c61ab16]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rubtNJCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:29:02 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqdAHQpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23838386434323632', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838386434323632', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.818s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:03 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:03 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a0fd25-b34a-4322-9ea5-e431be621ef9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:29:03 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:29:03 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:03 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:29:03 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:03 user nova-compute[75340]:   <serial>158cc9a0-1135-4815-9f1d-6ec2c493e7f6</serial>
Nov 30 09:29:03 user nova-compute[75340]: </disk>
Nov 30 09:29:03 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c59b3-8ff3-415c-ab1f-55b5bd2d26f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d] added
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea91ec-6ffb-43d0-88a3-faaaad306fe9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098dd82-7b65-4d39-8d57-b9e0c1cde7f9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rubtNJCR {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rubtNJCR" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f105c-4342-44f0-a230-5477d880318a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rubtNJCR'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241ba48-e3bb-424c-98ee-8f08ebb254b5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8512d-af8f-4b48-9e20-cf7d88932aa2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f2705-1adb-4041-a6dc-bc6b7a4bfcea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260]
Nov 30 09:29:03 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260] successful.
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e55a22-e342-4d47-84c8-66bef5e6f25c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed8870c-d0e2-4427-a524-803d35e59ec8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:03 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:03 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaba1a4-4319-4052-8271-6954f370b2b0]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:29:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rubtNJCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] No VIF found with MAC fa:16:3e:0f:a2:53, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:29:04 user nova-compute[75340]: INFO nova.compute.manager [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Unrescuing
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquired lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2ce4305b-3fc8-4743-b2a7-300b5ebae7c2 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.666s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [{"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Releasing lock "refresh_cache-0bbdc278-80bc-4c20-87fa-2675a63ea503" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'flavor' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:04 user nova-compute[75340]: WARNING nova.compute.manager [req-957108cd-c5e6-4a80-b8bc-137e13cae085 req-546e6d19-90be-4dd3-8bf0-86f9063cd591 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] <== connect_volume: return (2173ms) {'type': 'block', 'scsi_wwn': '26462336565396230', 'path': '/dev/sdf'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462336565396230', 'path': '/dev/sdf'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:29:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'flavor' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:29:05 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:05 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:29:05 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:05 user nova-compute[75340]:   <serial>e360513f-76a7-473f-9de9-76766af24a8d</serial>
Nov 30 09:29:05 user nova-compute[75340]: </disk>
Nov 30 09:29:05 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:7f:a8:88, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cc5c27ee-141b-431d-bcfd-b4cac0500949 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.161s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:05 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance destroyed successfully.
Nov 30 09:29:05 user nova-compute[75340]: INFO nova.compute.manager [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Rescuing
Nov 30 09:29:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:05 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:06 user nova-compute[75340]: WARNING nova.compute.manager [req-97232ba6-bd19-4566-8ed3-14491626dd0f req-afdcd45e-685b-4ca6-b82d-167140b62b42 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state active and task_state rescuing.
Nov 30 09:29:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:06 user nova-compute[75340]: DEBUG nova.compute.manager [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:06 user nova-compute[75340]: WARNING nova.compute.manager [req-756b2e6e-0208-4638-b983-53c47a52c4e6 req-6d9dad06-5e5d-40f5-87e1-edd9123fb5f9 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance destroyed successfully.
Nov 30 09:29:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Attempting rescue
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75340) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance directory exists: not creating {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 09:29:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Creating image(s)
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue" returned: 0 in 0.059s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'migration_context' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.base [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<28ec2815-8cb8-476b-a830-aab627c77a14> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start _get_guest_xml network_info=[{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:7f:a8:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.base [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<28ec2815-8cb8-476b-a830-aab627c77a14> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'numa_topology' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.base [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<28ec2815-8cb8-476b-a830-aab627c77a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:07 user nova-compute[75340]: DEBUG nova.objects.base [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<28ec2815-8cb8-476b-a830-aab627c77a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578052888',display_name='tempest-ServerRescueNegativeTestJSON-server-578052888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578052888',id=34,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsCBd2ReazykrovKRl1b2E+iXX1BKrpy8UtkoWEeWMTUT+3OykqKpzQehFh0Lv88PF+EODJwGHHO6BFvri7Xw2bmHCLJUAVgmXGerC2B7dAcpxeo2RcivWUDQTMJmnsjQ==',key_name='tempest-keypair-127598941',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-lkhvjnx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=28ec2815-8cb8-476b-a830-aab627c77a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:7f:a8:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "vif_mac": "fa:16:3e:7f:a8:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'pci_devices' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.objects.base [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Object Instance<28ec2815-8cb8-476b-a830-aab627c77a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:29:08 user nova-compute[75340]:   <uuid>28ec2815-8cb8-476b-a830-aab627c77a14</uuid>
Nov 30 09:29:08 user nova-compute[75340]:   <name>instance-00000022</name>
Nov 30 09:29:08 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:29:08 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:29:08 user nova-compute[75340]:   <metadata>
Nov 30 09:29:08 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:29:08 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578052888</nova:name>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:29:07</nova:creationTime>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:29:08 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:29:08 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:owner>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:user uuid="221aef7b87f64a96a9fa77bcec0834ca">tempest-ServerRescueNegativeTestJSON-1146573411-project-member</nova:user>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:project uuid="cba97ab8c36f4de8ba045c19af810242">tempest-ServerRescueNegativeTestJSON-1146573411</nova:project>
Nov 30 09:29:08 user nova-compute[75340]:       </nova:owner>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:29:08 user nova-compute[75340]:       <nova:ports>
Nov 30 09:29:08 user nova-compute[75340]:         <nova:port uuid="99eb1c19-9dbf-45a6-9164-918c020b2c8c">
Nov 30 09:29:08 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:29:08 user nova-compute[75340]:         </nova:port>
Nov 30 09:29:08 user nova-compute[75340]:       </nova:ports>
Nov 30 09:29:08 user nova-compute[75340]:     </nova:instance>
Nov 30 09:29:08 user nova-compute[75340]:   </metadata>
Nov 30 09:29:08 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:29:08 user nova-compute[75340]:     <system>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="serial">28ec2815-8cb8-476b-a830-aab627c77a14</entry>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="uuid">28ec2815-8cb8-476b-a830-aab627c77a14</entry>
Nov 30 09:29:08 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:29:08 user nova-compute[75340]:     </system>
Nov 30 09:29:08 user nova-compute[75340]:   </sysinfo>
Nov 30 09:29:08 user nova-compute[75340]:   <os>
Nov 30 09:29:08 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:29:08 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:29:08 user nova-compute[75340]:   </os>
Nov 30 09:29:08 user nova-compute[75340]:   <features>
Nov 30 09:29:08 user nova-compute[75340]:     <acpi/>
Nov 30 09:29:08 user nova-compute[75340]:     <apic/>
Nov 30 09:29:08 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:29:08 user nova-compute[75340]:   </features>
Nov 30 09:29:08 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:29:08 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:29:08 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:29:08 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:29:08 user nova-compute[75340]:   </clock>
Nov 30 09:29:08 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:29:08 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:29:08 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:29:08 user nova-compute[75340]:   </cpu>
Nov 30 09:29:08 user nova-compute[75340]:   <devices>
Nov 30 09:29:08 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:29:08 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:29:08 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue"/>
Nov 30 09:29:08 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:29:08 user nova-compute[75340]:     </disk>
Nov 30 09:29:08 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:29:08 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:29:08 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk"/>
Nov 30 09:29:08 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:29:08 user nova-compute[75340]:     </disk>
Nov 30 09:29:08 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:29:08 user nova-compute[75340]:       <mac address="fa:16:3e:7f:a8:88"/>
Nov 30 09:29:08 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:29:08 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:29:08 user nova-compute[75340]:       <target dev="tap99eb1c19-9d"/>
Nov 30 09:29:08 user nova-compute[75340]:     </interface>
Nov 30 09:29:08 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:29:08 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/console.log" append="off"/>
Nov 30 09:29:08 user nova-compute[75340]:     </serial>
Nov 30 09:29:08 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:29:08 user nova-compute[75340]:     <video>
Nov 30 09:29:08 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:29:08 user nova-compute[75340]:     </video>
Nov 30 09:29:08 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:29:08 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:29:08 user nova-compute[75340]:     </rng>
Nov 30 09:29:08 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:29:08 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:29:08 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:29:08 user nova-compute[75340]:     </memballoon>
Nov 30 09:29:08 user nova-compute[75340]:   </devices>
Nov 30 09:29:08 user nova-compute[75340]: </domain>
Nov 30 09:29:08 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:29:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance destroyed successfully.
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] No VIF found with MAC fa:16:3e:7f:a8:88, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:08 user nova-compute[75340]: WARNING nova.compute.manager [req-3dd14873-4b56-4cc3-b00e-e8b0b9f1a363 req-bbb82d3f-a851-400a-b45e-f62cc3ffe278 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state active and task_state rescuing.
Nov 30 09:29:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:09 user nova-compute[75340]: WARNING nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:09 user nova-compute[75340]: WARNING nova.compute.manager [req-bcb756f6-2c13-4b2b-bd1f-cc5781134cbf req-33ecc0ff-b742-4c9b-8f03-5f105b877ee6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a06b3637-22d1-4985-9d3e-9e03e49a1966 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:10 user nova-compute[75340]: WARNING nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state active and task_state rescuing.
Nov 30 09:29:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:10 user nova-compute[75340]: WARNING nova.compute.manager [req-94e41e3e-a931-4aa3-85d3-eecaea12fc2a req-db6f5865-21d1-4d4b-a8cd-4874c061cc6d service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state active and task_state rescuing.
Nov 30 09:29:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6cee4416-0301-4cc2-b2f3-a5b1b18f3aff tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:29:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:14 user nova-compute[75340]: INFO nova.compute.manager [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Unrescuing
Nov 30 09:29:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'flavor' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:15 user nova-compute[75340]: WARNING nova.compute.manager [req-97f1c377-3c3d-4d54-bfab-9d811f4cca5e req-dc489321-c3b9-4c9c-acae-aa2be289541d service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing instance network info cache due to event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:29:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance destroyed successfully.
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updated VIF entry in instance network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9e7103b6-5aba-4f38-8b30-275f31f46281 req-6e81920d-ccb6-4848-89e5-b61febadf826 service nova] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:17 user nova-compute[75340]: WARNING nova.compute.manager [req-c52595fd-464f-4893-8a31-2b020dc87d3d req-022b6cfc-7f86-452e-a4a7-93083a1791b2 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing instance network info cache due to event network-changed-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] Acquiring lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] Acquired lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Refreshing network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updated VIF entry in instance network info cache for port 6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [{"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ffac8131-64fe-44e9-8357-dae640757622 req-f7ef37ef-6a6e-4d38-8bac-723e9e2c3b3f service nova] Releasing lock "refresh_cache-be9c04f6-a829-40a7-90aa-9de247e82875" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:19 user nova-compute[75340]: WARNING nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:19 user nova-compute[75340]: WARNING nova.compute.manager [req-e224cd03-b1a3-4b1c-bce7-adf23f637db3 req-eca6e1d5-433e-4828-88de-daf8de019810 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:29:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-73e40485-2afd-4fd6-9db5-94abb081f16f tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquired lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG nova.network.neutron [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'info_cache' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:20 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Releasing lock "refresh_cache-9c6c4ed4-4acc-4a24-bf80-820a72587045" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:21 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance destroyed successfully.
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'resources' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG os_vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc57b695b-79, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ece7067-cd6a-4d25-8608-1c5f95bdc860) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:21 user nova-compute[75340]: INFO os_vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start _get_guest_xml network_info=[{"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:29:21 user nova-compute[75340]:   <uuid>9c6c4ed4-4acc-4a24-bf80-820a72587045</uuid>
Nov 30 09:29:21 user nova-compute[75340]:   <name>instance-00000019</name>
Nov 30 09:29:21 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:29:21 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:29:21 user nova-compute[75340]:   <metadata>
Nov 30 09:29:21 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:29:21 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeTestJSON-server-1854362006</nova:name>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:29:21</nova:creationTime>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:29:21 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:29:21 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:owner>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:user uuid="82d13c8d8c984172a828f34deb3f9bf6">tempest-AttachVolumeTestJSON-158840588-project-member</nova:user>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:project uuid="cca9314cdc634dfa9df097fcd53c2c2c">tempest-AttachVolumeTestJSON-158840588</nova:project>
Nov 30 09:29:21 user nova-compute[75340]:       </nova:owner>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:29:21 user nova-compute[75340]:       <nova:ports>
Nov 30 09:29:21 user nova-compute[75340]:         <nova:port uuid="c57b695b-790c-46f8-acab-abc09cccf781">
Nov 30 09:29:21 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:29:21 user nova-compute[75340]:         </nova:port>
Nov 30 09:29:21 user nova-compute[75340]:       </nova:ports>
Nov 30 09:29:21 user nova-compute[75340]:     </nova:instance>
Nov 30 09:29:21 user nova-compute[75340]:   </metadata>
Nov 30 09:29:21 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:29:21 user nova-compute[75340]:     <system>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="serial">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="uuid">9c6c4ed4-4acc-4a24-bf80-820a72587045</entry>
Nov 30 09:29:21 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:29:21 user nova-compute[75340]:     </system>
Nov 30 09:29:21 user nova-compute[75340]:   </sysinfo>
Nov 30 09:29:21 user nova-compute[75340]:   <os>
Nov 30 09:29:21 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:29:21 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:29:21 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:29:21 user nova-compute[75340]:   </os>
Nov 30 09:29:21 user nova-compute[75340]:   <features>
Nov 30 09:29:21 user nova-compute[75340]:     <acpi/>
Nov 30 09:29:21 user nova-compute[75340]:     <apic/>
Nov 30 09:29:21 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:29:21 user nova-compute[75340]:   </features>
Nov 30 09:29:21 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:29:21 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:29:21 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:29:21 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:29:21 user nova-compute[75340]:   </clock>
Nov 30 09:29:21 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:29:21 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:29:21 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:29:21 user nova-compute[75340]:   </cpu>
Nov 30 09:29:21 user nova-compute[75340]:   <devices>
Nov 30 09:29:21 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:29:21 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:29:21 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk"/>
Nov 30 09:29:21 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:29:21 user nova-compute[75340]:     </disk>
Nov 30 09:29:21 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:29:21 user nova-compute[75340]:       <mac address="fa:16:3e:d4:c0:a7"/>
Nov 30 09:29:21 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:29:21 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:29:21 user nova-compute[75340]:       <target dev="tapc57b695b-79"/>
Nov 30 09:29:21 user nova-compute[75340]:     </interface>
Nov 30 09:29:21 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:29:21 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/console.log" append="off"/>
Nov 30 09:29:21 user nova-compute[75340]:     </serial>
Nov 30 09:29:21 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:29:21 user nova-compute[75340]:     <video>
Nov 30 09:29:21 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:29:21 user nova-compute[75340]:     </video>
Nov 30 09:29:21 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:29:21 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:29:21 user nova-compute[75340]:     </rng>
Nov 30 09:29:21 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:29:21 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:29:21 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:29:21 user nova-compute[75340]:     </memballoon>
Nov 30 09:29:21 user nova-compute[75340]:   </devices>
Nov 30 09:29:21 user nova-compute[75340]: </domain>
Nov 30 09:29:21 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Cannot resize image /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'migration_context' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.objects.base [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Object Instance<9c6c4ed4-4acc-4a24-bf80-820a72587045> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG os_vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50fb9c37-fed0-51b1-97e6-b829e26da570', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc57b695b-79, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc57b695b-79, col_values=(('qos', UUID('6a45d415-139f-48eb-9a08-fce5b88124fe')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc57b695b-79, col_values=(('external_ids', {'iface-id': 'c57b695b-790c-46f8-acab-abc09cccf781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c0:a7', 'vm-uuid': '9c6c4ed4-4acc-4a24-bf80-820a72587045'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:22 user nova-compute[75340]: INFO os_vif [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:29:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:24 user nova-compute[75340]: WARNING nova.compute.manager [req-c13c0bb5-609e-4884-9681-4e32fc3904f4 req-26e9f684-bbbf-4b00-9db5-42fe09bd8f4d service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state powering-on.
Nov 30 09:29:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:29:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance rebooted successfully.
Nov 30 09:29:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-54c498e4-c631-4733-87bb-1e61bfb17482 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:26 user nova-compute[75340]: WARNING nova.compute.manager [req-a4ae2cea-858e-4ed7-9f73-23ba5f57c71f req-144edcea-a05a-4d8e-a061-359f30773821 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state stopped and task_state powering-on.
Nov 30 09:29:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:34 user nova-compute[75340]: INFO nova.compute.manager [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Detaching volume 158cc9a0-1135-4815-9f1d-6ec2c493e7f6
Nov 30 09:29:34 user nova-compute[75340]: INFO nova.virt.block_device [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Attempting to driver detach volume 158cc9a0-1135-4815-9f1d-6ec2c493e7f6 from mountpoint /dev/vdb
Nov 30 09:29:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Attempting to detach device vdb from instance 03d69b0b-090c-440f-b615-02574eb5d847 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:29:34 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:34 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:29:34 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:34 user nova-compute[75340]:   <serial>158cc9a0-1135-4815-9f1d-6ec2c493e7f6</serial>
Nov 30 09:29:34 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:29:34 user nova-compute[75340]: </disk>
Nov 30 09:29:34 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:29:34 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully detached device vdb from instance 03d69b0b-090c-440f-b615-02574eb5d847 from the persistent domain config.
Nov 30 09:29:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03d69b0b-090c-440f-b615-02574eb5d847 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:29:34 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:34 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:29:34 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:34 user nova-compute[75340]:   <serial>158cc9a0-1135-4815-9f1d-6ec2c493e7f6</serial>
Nov 30 09:29:34 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:29:34 user nova-compute[75340]: </disk>
Nov 30 09:29:34 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:29:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:29:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Going to confirm migration 2 {{(pid=75340) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquired lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:39 user nova-compute[75340]: DEBUG nova.objects.instance [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'info_cache' on Instance uuid f1271f7f-d3d0-4d07-b9ee-50592fc9de61 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [{"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Releasing lock "refresh_cache-f1271f7f-d3d0-4d07-b9ee-50592fc9de61" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'migration_context' on Instance uuid f1271f7f-d3d0-4d07-b9ee-50592fc9de61 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG nova.objects.base [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Object Instance<f1271f7f-d3d0-4d07-b9ee-50592fc9de61> lazy-loaded attributes: info_cache,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:29:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.579s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:41 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Deleted allocation for migration 0b6fa1a8-6ac8-4d20-8905-f1dc9150bb04
Nov 30 09:29:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-aa624492-bf83-486c-8d9a-a83e77bff96e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.960s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Skipping network cache update for instance because it is being deleted. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:29:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 342c9729-6990-4f95-8d1e-6c3ba45a881c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [{"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-342c9729-6990-4f95-8d1e-6c3ba45a881c" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: INFO nova.compute.manager [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Detaching volume 3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:29:47 user nova-compute[75340]: INFO nova.virt.block_device [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Attempting to driver detach volume 3090dd3f-5708-4ec7-b9f9-3675d34a722f from mountpoint /dev/vdb
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Attempting to detach device vdb from instance be9c04f6-a829-40a7-90aa-9de247e82875 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:29:47 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:47 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:29:47 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:47 user nova-compute[75340]:   <serial>3090dd3f-5708-4ec7-b9f9-3675d34a722f</serial>
Nov 30 09:29:47 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:29:47 user nova-compute[75340]: </disk>
Nov 30 09:29:47 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:29:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Successfully detached device vdb from instance be9c04f6-a829-40a7-90aa-9de247e82875 from the persistent domain config.
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be9c04f6-a829-40a7-90aa-9de247e82875 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:29:47 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:29:47 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:29:47 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:29:47 user nova-compute[75340]:   <serial>3090dd3f-5708-4ec7-b9f9-3675d34a722f</serial>
Nov 30 09:29:47 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:29:47 user nova-compute[75340]: </disk>
Nov 30 09:29:47 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:29:48 user nova-compute[75340]: INFO nova.compute.claims [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Claim successful on node user
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.128s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:29:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.policy [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '167a6f85251d4513b9953681ac119e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1a9ce07006430d92f23d4161b70f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:29:49 user nova-compute[75340]: INFO nova.virt.block_device [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Booting with volume bb2be1b3-b3c4-43be-acf2-44261f483f35 at /dev/vda
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.utils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3602edf-c865-42bd-9153-a25fa5a57d5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[439715ac-de51-4fe0-a9af-06d3bae90132]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5107a7c5-2707-4974-a4f3-6889fd266e17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad87e9-b071-41ea-b139-000cfc8c1fc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:29:49 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ebbc9-81bb-438d-a1e9-a1694a59667c]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG os_brick.utils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating existing volume attachment record: f7247264-4b56-47e9-bc9d-aef7a9d3e044 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:49 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Successfully created port: e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Successfully updated port: e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing instance network info cache due to event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:50 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance network_info: |[{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updated VIF entry in instance network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f1725f64-1903-4ba3-bdb9-fb9e1d1b4077 req-97892c5c-829b-4f83-b178-b5001afa3f5c service nova] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:54 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:29:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=6821MB free_disk=24.766010284423828GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance be9c04f6-a829-40a7-90aa-9de247e82875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 03d69b0b-090c-440f-b615-02574eb5d847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 5c3289ef-6c16-4296-82f8-173a7cdd3cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 308ab353-749a-464b-affe-811f4292a492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:29:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03d69b0b-090c-440f-b615-02574eb5d847 is timed out.
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully detached device vdb from instance 03d69b0b-090c-440f-b615-02574eb5d847 from the live domain config.
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqdAHQpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:29:55 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3aba0a-b2fe-4b73-ae16-d99d25f4e81d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:29:55 user nova-compute[75340]: No targets found.
Nov 30 09:29:55 user nova-compute[75340]: iSNS:
Nov 30 09:29:55 user nova-compute[75340]: No targets found.
Nov 30 09:29:55 user nova-compute[75340]: STATIC:
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6
Nov 30 09:29:55 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:55 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:55 user nova-compute[75340]: FIRMWARE:
Nov 30 09:29:55 user nova-compute[75340]: No targets found.
Nov 30 09:29:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:29:55 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:29:55 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a460de-bf25-4026-813c-d1830465688d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40371b9-c903-4e4b-9aa6-07149f682a2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.compute.manager [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Terminating instance
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 (non-flash)
Nov 30 09:29:55 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff30423370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b3c2b-b1c3-477f-af39-df776902d861]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a93217-af64-4492-b220-331bc911e47d]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594e91f-76cd-4bab-8eaf-04c6c3587460]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940831f-24a2-4641-901e-382a8b426420]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76987a64-f190-45e8-9f81-71b9560c3092]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2ba60-7060-492e-a163-4f46d8fe0422]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260]
Nov 30 09:29:55 user nova-compute[75340]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6, portal: 172.16.0.220,3260] successful.
Nov 30 09:29:55 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248de5e-1560-440c-bba3-f8bd7847d25b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== disconnect_volume: return (434ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Instance destroyed successfully.
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.objects.instance [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lazy-loading 'resources' on Instance uuid 5c3289ef-6c16-4296-82f8-173a7cdd3cc2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1718600492',display_name='tempest-VolumesActionsTest-instance-1718600492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1718600492',id=36,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:28:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ba603fbafbe4bc6bda4cadaafc64f0a',ramdisk_id='',reservation_id='r-f08qzwgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1790057548',owner_user_name='tempest-VolumesActionsTest-1790057548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:28:11Z,user_data=None,user_id='49bf7b06ea4d4c12974e71198ab41be3',uuid=5c3289ef-6c16-4296-82f8-173a7cdd3cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converting VIF {"id": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "address": "fa:16:3e:17:4f:2a", "network": {"id": "7d88251d-9a74-4460-855b-7555542c2003", "bridge": "br-int", "label": "tempest-VolumesActionsTest-903767640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba603fbafbe4bc6bda4cadaafc64f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f31ea8b-3d", "ovs_interfaceid": "9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG os_vif [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f31ea8b-3d, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.094s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe4e49f7-faa2-4233-add0-6943dbbf49df) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:55 user nova-compute[75340]: INFO os_vif [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:2a,bridge_name='br-int',has_traffic_filtering=True,id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab,network=Network(7d88251d-9a74-4460-855b-7555542c2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f31ea8b-3d')
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Deleting instance files /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2_del
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Deletion of /opt/stack/data/nova/instances/5c3289ef-6c16-4296-82f8-173a7cdd3cc2_del complete
Nov 30 09:29:55 user nova-compute[75340]: INFO nova.compute.manager [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 30 09:29:55 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:29:55 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-unplugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] No waiting events found dispatching network-vif-unplugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-a72e9d2e-2591-4f66-a804-470a13e31710 req-5fa93a24-871f-490e-b19e-488226c91add service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-unplugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'flavor' on Instance uuid 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7fb62f64-f933-4956-9a9b-946a72da45fa tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.760s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:56 user nova-compute[75340]: INFO nova.compute.manager [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Terminating instance
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:56 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Took 0.58 seconds to deallocate network for instance.
Nov 30 09:29:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-33f6b081-872d-42e4-9713-439c18ea5b63 req-31952bbf-fc1d-400a-a7c7-400a4bbfe088 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-deleted-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:56 user nova-compute[75340]: INFO nova.compute.manager [req-33f6b081-872d-42e4-9713-439c18ea5b63 req-31952bbf-fc1d-400a-a7c7-400a4bbfe088 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Neutron deleted interface 9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab; detaching it from the instance and deleting it from the info cache
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-33f6b081-872d-42e4-9713-439c18ea5b63 req-31952bbf-fc1d-400a-a7c7-400a4bbfe088 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-33f6b081-872d-42e4-9713-439c18ea5b63 req-31952bbf-fc1d-400a-a7c7-400a4bbfe088 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Detach interface failed, port_id=9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab, reason: Instance 5c3289ef-6c16-4296-82f8-173a7cdd3cc2 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:57 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Deleted allocations for instance 5c3289ef-6c16-4296-82f8-173a7cdd3cc2
Nov 30 09:29:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Instance destroyed successfully.
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lazy-loading 'resources' on Instance uuid 03d69b0b-090c-440f-b615-02574eb5d847 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-484540dd-f034-47ed-b90a-537fe20e8de7 tempest-VolumesActionsTest-1790057548 tempest-VolumesActionsTest-1790057548-project-member] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1603761008',display_name='tempest-VolumesSnapshotTestJSON-instance-1603761008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1603761008',id=35,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkpEq2XEX1Nld//gAFDIbqHqTuiDeLpeGtnBJXCQISxuG2UlmujCUTkS2/kBrKufwL9Pu4KW7JO7mEaemSUSXIQ0HsKUTD0q3S8Pgd/DMvdIoN8uSxRfoZQUBNUXgtAZQ==',key_name='tempest-keypair-318437605',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efd2c3d22b4a43208d002d0a7f619c4b',ramdisk_id='',reservation_id='r-yseniah2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1914221383',owner_user_name='tempest-VolumesSnapshotTestJSON-1914221383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52476e558c849af9399b952decd75f3',uuid=03d69b0b-090c-440f-b615-02574eb5d847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converting VIF {"id": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "address": "fa:16:3e:0f:a2:53", "network": {"id": "030e145f-5936-4be5-aef3-bec1f07e867d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1518059844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd2c3d22b4a43208d002d0a7f619c4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7d4c68-3c", "ovs_interfaceid": "cb7d4c68-3cf4-4037-8f13-bd48a9314c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_vif [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb7d4c68-3c, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e097f98f-fed3-4e05-a9f7-6df50aebc1ac) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:29:57 user nova-compute[75340]: INFO os_vif [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a2:53,bridge_name='br-int',has_traffic_filtering=True,id=cb7d4c68-3cf4-4037-8f13-bd48a9314c0a,network=Network(030e145f-5936-4be5-aef3-bec1f07e867d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7d4c68-3c')
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqdAHQpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:29:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308c420-e2ea-47a4-9544-8731c91c32ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:29:57 user nova-compute[75340]: No targets found.
Nov 30 09:29:57 user nova-compute[75340]: iSNS:
Nov 30 09:29:57 user nova-compute[75340]: No targets found.
Nov 30 09:29:57 user nova-compute[75340]: STATIC:
Nov 30 09:29:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:29:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:29:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:29:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:29:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:29:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:29:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:29:57 user nova-compute[75340]: FIRMWARE:
Nov 30 09:29:57 user nova-compute[75340]: No targets found.
Nov 30 09:29:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:29:57 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:29:57 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:158cc9a0-1135-4815-9f1d-6ec2c493e7f6', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d207ed-3002-4184-a3e1-be5e16ca2ed5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01fa61-93fb-4a1b-9071-2588a87994d6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:29:57 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:29:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff501d3250>, {}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Disconnecting from: [] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] <== disconnect_volume: return (85ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:29:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Deleting instance files /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847_del
Nov 30 09:29:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Deletion of /opt/stack/data/nova/instances/03d69b0b-090c-440f-b615-02574eb5d847_del complete
Nov 30 09:29:57 user nova-compute[75340]: INFO nova.compute.manager [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:29:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Acquiring lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "5c3289ef-6c16-4296-82f8-173a7cdd3cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] No waiting events found dispatching network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:58 user nova-compute[75340]: WARNING nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 5c3289ef-6c16-4296-82f8-173a7cdd3cc2] Received unexpected event network-vif-plugged-9f31ea8b-3d59-46b1-bff8-5cd55b6ba1ab for instance with vm_state deleted and task_state None.
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-unplugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] No waiting events found dispatching network-vif-unplugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-unplugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Acquiring lock "03d69b0b-090c-440f-b615-02574eb5d847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] Lock "03d69b0b-090c-440f-b615-02574eb5d847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] No waiting events found dispatching network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:29:58 user nova-compute[75340]: WARNING nova.compute.manager [req-5d849f2f-5c3e-43af-86f1-8655a7a42fe4 req-f7f37d11-acfd-435d-9610-1254fe37de20 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received unexpected event network-vif-plugged-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a for instance with vm_state active and task_state deleting.
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:29:58 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Took 0.68 seconds to deallocate network for instance.
Nov 30 09:29:58 user nova-compute[75340]: WARNING nova.volume.cinder [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Attachment b2139563-ea32-4cb7-b3cd-e480a9c0ce6a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b2139563-ea32-4cb7-b3cd-e480a9c0ce6a. (HTTP 404) (Request-ID: req-89357400-be60-47a7-9eb0-aef4951e5c0b)
Nov 30 09:29:58 user nova-compute[75340]: INFO nova.compute.manager [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-054b8b02-8ff0-48e3-b990-efff71c15cbe req-b3c19850-9cfa-46af-bd93-c472607db4d4 service nova] [instance: 03d69b0b-090c-440f-b615-02574eb5d847] Received event network-vif-deleted-cb7d4c68-3cf4-4037-8f13-bd48a9314c0a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:29:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:29:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:29:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:29:59 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Deleted allocations for instance 03d69b0b-090c-440f-b615-02574eb5d847
Nov 30 09:29:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-750647ae-2339-4be2-a4ff-8307aa123718 tempest-VolumesSnapshotTestJSON-1914221383 tempest-VolumesSnapshotTestJSON-1914221383-project-member] Lock "03d69b0b-090c-440f-b615-02574eb5d847" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:30:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Creating image(s)
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start _get_guest_xml network_info=[{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f7247264-4b56-47e9-bc9d-aef7a9d3e044', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06803cbd-89e9-40c6-90fe-cdb61836e4d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb2be1b3-b3c4-43be-acf2-44261f483f35', 'serial': 'bb2be1b3-b3c4-43be-acf2-44261f483f35'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:30:02 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:30:02 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:02 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:02 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:02 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a199ce4-a0b5-4383-b968-07ac651f4427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:30:02 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec598c-5994-475d-b3af-396aa80fb8c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35] added
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bdfd7-d738-4c9a-9d5b-c72723a25894]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24761a-181f-4bd6-b12d-e03588ebfa06]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqLgQrTs {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqLgQrTs" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d8c67-1f5d-4b8f-9dab-5399c5fb85d9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqLgQrTs'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc910ff-d40b-42e6-9cbc-bb2015920445]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a73bc2-f0e2-49d0-a6b2-7497bba62a0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4acea-0046-42ec-8901-b4d2007b56d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]
Nov 30 09:30:02 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ec28cf-9de6-47e6-a051-5f732c56ad90]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be2e71-1163-4962-aafb-3355a92fd70d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:02 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdeb42a-4809-41e4-9794-c18deabef5ca]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:30:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26632346138663333', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632346138663333', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4tX1juoszHD+LgbJiLCUWaNOcoqhH5w5hk17UFwDFfUS/9EREkMw42nljfwLj3/IkcRNpJnl0isRswatJxczgJ13HEsFrQPFPiUvjn71dOpijedxa2rYoeQeKWSPPf9Q==',key_name='tempest-TestShelveInstance-1377343270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:29:49Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'pci_devices' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:30:03 user nova-compute[75340]:   <uuid>06803cbd-89e9-40c6-90fe-cdb61836e4d7</uuid>
Nov 30 09:30:03 user nova-compute[75340]:   <name>instance-00000026</name>
Nov 30 09:30:03 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:30:03 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:30:03 user nova-compute[75340]:   <metadata>
Nov 30 09:30:03 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:30:03 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:30:03 user nova-compute[75340]:       <nova:name>tempest-TestShelveInstance-server-256984797</nova:name>
Nov 30 09:30:03 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:30:02</nova:creationTime>
Nov 30 09:30:03 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:30:03 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:30:03 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:30:03 user nova-compute[75340]:       <nova:owner>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:user uuid="167a6f85251d4513b9953681ac119e66">tempest-TestShelveInstance-187239747-project-member</nova:user>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:project uuid="5f1a9ce07006430d92f23d4161b70f01">tempest-TestShelveInstance-187239747</nova:project>
Nov 30 09:30:03 user nova-compute[75340]:       </nova:owner>
Nov 30 09:30:03 user nova-compute[75340]:       <nova:ports>
Nov 30 09:30:03 user nova-compute[75340]:         <nova:port uuid="e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8">
Nov 30 09:30:03 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:30:03 user nova-compute[75340]:         </nova:port>
Nov 30 09:30:03 user nova-compute[75340]:       </nova:ports>
Nov 30 09:30:03 user nova-compute[75340]:     </nova:instance>
Nov 30 09:30:03 user nova-compute[75340]:   </metadata>
Nov 30 09:30:03 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:30:03 user nova-compute[75340]:     <system>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="serial">06803cbd-89e9-40c6-90fe-cdb61836e4d7</entry>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="uuid">06803cbd-89e9-40c6-90fe-cdb61836e4d7</entry>
Nov 30 09:30:03 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:30:03 user nova-compute[75340]:     </system>
Nov 30 09:30:03 user nova-compute[75340]:   </sysinfo>
Nov 30 09:30:03 user nova-compute[75340]:   <os>
Nov 30 09:30:03 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:30:03 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:30:03 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:30:03 user nova-compute[75340]:   </os>
Nov 30 09:30:03 user nova-compute[75340]:   <features>
Nov 30 09:30:03 user nova-compute[75340]:     <acpi/>
Nov 30 09:30:03 user nova-compute[75340]:     <apic/>
Nov 30 09:30:03 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:30:03 user nova-compute[75340]:   </features>
Nov 30 09:30:03 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:30:03 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:30:03 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:30:03 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:30:03 user nova-compute[75340]:   </clock>
Nov 30 09:30:03 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:30:03 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:30:03 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:30:03 user nova-compute[75340]:   </cpu>
Nov 30 09:30:03 user nova-compute[75340]:   <devices>
Nov 30 09:30:03 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:30:03 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:30:03 user nova-compute[75340]:       <source dev="/dev/sdd"/>
Nov 30 09:30:03 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:30:03 user nova-compute[75340]:       <serial>bb2be1b3-b3c4-43be-acf2-44261f483f35</serial>
Nov 30 09:30:03 user nova-compute[75340]:     </disk>
Nov 30 09:30:03 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:30:03 user nova-compute[75340]:       <mac address="fa:16:3e:fb:98:b2"/>
Nov 30 09:30:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:30:03 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:30:03 user nova-compute[75340]:       <target dev="tape87c43f9-1b"/>
Nov 30 09:30:03 user nova-compute[75340]:     </interface>
Nov 30 09:30:03 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:30:03 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7/console.log" append="off"/>
Nov 30 09:30:03 user nova-compute[75340]:     </serial>
Nov 30 09:30:03 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:30:03 user nova-compute[75340]:     <video>
Nov 30 09:30:03 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:30:03 user nova-compute[75340]:     </video>
Nov 30 09:30:03 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:30:03 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:30:03 user nova-compute[75340]:     </rng>
Nov 30 09:30:03 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:30:03 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:30:03 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:30:03 user nova-compute[75340]:     </memballoon>
Nov 30 09:30:03 user nova-compute[75340]:   </devices>
Nov 30 09:30:03 user nova-compute[75340]: </domain>
Nov 30 09:30:03 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4tX1juoszHD+LgbJiLCUWaNOcoqhH5w5hk17UFwDFfUS/9EREkMw42nljfwLj3/IkcRNpJnl0isRswatJxczgJ13HEsFrQPFPiUvjn71dOpijedxa2rYoeQeKWSPPf9Q==',key_name='tempest-TestShelveInstance-1377343270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:29:49Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG os_vif [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d6788f4-4118-5f45-9640-6869bf15b801', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87c43f9-1b, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape87c43f9-1b, col_values=(('qos', UUID('0429eb23-49bb-4c44-8cd8-d00600c3184b')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape87c43f9-1b, col_values=(('external_ids', {'iface-id': 'e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:98:b2', 'vm-uuid': '06803cbd-89e9-40c6-90fe-cdb61836e4d7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:03 user nova-compute[75340]: INFO os_vif [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b')
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:30:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] No VIF found with MAC fa:16:3e:fb:98:b2, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:30:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG nova.compute.manager [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG nova.compute.manager [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:05 user nova-compute[75340]: WARNING nova.compute.manager [req-7f8aeee8-67d2-47ab-aca4-24d430808da2 req-b2892cd9-d5aa-45c9-9a8c-e7ae8b8d7a33 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state building and task_state spawning.
Nov 30 09:30:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:30:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:30:06 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance spawned successfully.
Nov 30 09:30:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:30:07 user nova-compute[75340]: INFO nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:30:07 user nova-compute[75340]: INFO nova.compute.manager [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Took 18.83 seconds to build instance.
Nov 30 09:30:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fd943782-8e04-4ff5-8271-d2f3a41a6b90 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.930s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:07 user nova-compute[75340]: WARNING nova.compute.manager [req-28061656-cc3e-4856-95e0-03178bbcfebf req-45424805-d310-466f-9dd2-6013404ffafc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state active and task_state None.
Nov 30 09:30:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be9c04f6-a829-40a7-90aa-9de247e82875 is timed out.
Nov 30 09:30:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Successfully detached device vdb from instance be9c04f6-a829-40a7-90aa-9de247e82875 from the live domain config.
Nov 30 09:30:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUSZcRgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:07 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[014bb3ae-3a1b-4321-89d5-88299c8bda6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:30:08 user nova-compute[75340]: No targets found.
Nov 30 09:30:08 user nova-compute[75340]: iSNS:
Nov 30 09:30:08 user nova-compute[75340]: No targets found.
Nov 30 09:30:08 user nova-compute[75340]: STATIC:
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:30:08 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:08 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:08 user nova-compute[75340]: FIRMWARE:
Nov 30 09:30:08 user nova-compute[75340]: No targets found.
Nov 30 09:30:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:30:08 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:30:08 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6659ffc-2053-4e1d-bc95-dd9c4dcae496]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d1657d-cd37-4c63-8fa3-1d1c25022d16]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:08 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5026cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f'): ({'sdg'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Removing single pathed devices sdg {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6914ed36-81d0-4bb0-8139-e69566d56a6e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af93afd-62e5-43f9-8a9f-5b76a813a071]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Flushing IO for device /dev/sdg {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6b2196-7043-40f3-942a-8bcad61ce624]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce1fa6-56a7-40ca-bf1e-1bc2381af8ce]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152ebf1-0593-4750-92f2-e28e1708890f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[82444217-568d-45a6-97ca-99bffd5ae732]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260]
Nov 30 09:30:08 user nova-compute[75340]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f, portal: 172.16.0.220,3260] successful.
Nov 30 09:30:08 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3090dd3f-5708-4ec7-b9f9-3675d34a722f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5fad8-59ec-4874-8580-068fdb6840a0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] <== disconnect_volume: return (325ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:30:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:09 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'flavor' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6141fe67-79d0-448d-973f-56981d410ee1 tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-changed-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing instance network info cache due to event network-changed-d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] Acquiring lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] Acquired lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing network info cache for port d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updated VIF entry in instance network info cache for port d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.network.neutron [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating instance_info_cache with network_info: [{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ad3b3b2e-7dd3-4523-aea9-490179a595e9 req-ad4df3ae-caa4-4db8-aa27-e482f665591d service nova] Releasing lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG nova.objects.instance [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:12 user nova-compute[75340]: INFO nova.compute.manager [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Attaching volume 68775839-d093-44a7-b295-f13151f0e3cb to /dev/vdb
Nov 30 09:30:12 user nova-compute[75340]: DEBUG os_brick.utils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4e2f7-7730-4998-9c86-491079973036]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ecc0c-d80a-4876-9b03-299e7bf9dcb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[57183519-ff61-4a63-b8c3-363b2de05d7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8dda0-4a48-494c-b5b4-76f321c8b645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:30:13 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:30:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c6446-7ea3-462c-9eb1-8ced034ee77e]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG os_brick.utils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating existing volume attachment record: b01b3ae1-1e23-43ba-bf2b-f239c76f0831 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:30:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRMoAnjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:22 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91f27bd-acf0-4b82-be2f-17e85dfb81eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:30:22 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c19a51-45b1-4b2a-a95d-9a639108bd82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb] added
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8bd84b-ce48-47ff-9a46-9d96db624b88]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da83f9-73e9-483d-98da-59310b3cfff6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRMoAnjh {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRMoAnjh" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf39a0f-6b4d-4d63-9734-ede21687e1d2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRMoAnjh'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f617ffea-8ac4-412d-bfb5-81e7c2070a50]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91447e-6d8e-4f14-8c18-2697e1b58b12]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf2642-8d47-4079-8461-185fb196c181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260]
Nov 30 09:30:22 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260] successful.
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec75241-cb4f-4a22-8c21-11f089940ed1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49187b-96da-4c23-b8fe-f5e080ea098a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:22 user nova-compute[75340]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)
Nov 30 09:30:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d401c049-5731-4a9e-85d9-38bb46e2ddae]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:30:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRMoAnjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26261343137323866', 'path': '/dev/sdg'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261343137323866', 'path': '/dev/sdg'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG nova.objects.instance [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:30:23 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:30:23 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:30:23 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:30:23 user nova-compute[75340]:   <serial>68775839-d093-44a7-b295-f13151f0e3cb</serial>
Nov 30 09:30:23 user nova-compute[75340]: </disk>
Nov 30 09:30:23 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:30:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:30:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:30:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] No VIF found with MAC fa:16:3e:dd:0f:27, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:30:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-46826e13-96aa-4396-8e2c-ce7a83f7ba67 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.487s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:25 user nova-compute[75340]: INFO nova.compute.manager [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Detaching volume 68775839-d093-44a7-b295-f13151f0e3cb
Nov 30 09:30:25 user nova-compute[75340]: INFO nova.virt.block_device [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Attempting to driver detach volume 68775839-d093-44a7-b295-f13151f0e3cb from mountpoint /dev/vdb
Nov 30 09:30:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Attempting to detach device vdb from instance 308ab353-749a-464b-affe-811f4292a492 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:30:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:30:26 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:30:26 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:30:26 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:30:26 user nova-compute[75340]:   <serial>68775839-d093-44a7-b295-f13151f0e3cb</serial>
Nov 30 09:30:26 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:30:26 user nova-compute[75340]: </disk>
Nov 30 09:30:26 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:30:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully detached device vdb from instance 308ab353-749a-464b-affe-811f4292a492 from the persistent domain config.
Nov 30 09:30:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 308ab353-749a-464b-affe-811f4292a492 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:30:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:30:26 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:30:26 user nova-compute[75340]:   <source dev="/dev/sdg"/>
Nov 30 09:30:26 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:30:26 user nova-compute[75340]:   <serial>68775839-d093-44a7-b295-f13151f0e3cb</serial>
Nov 30 09:30:26 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:30:26 user nova-compute[75340]: </disk>
Nov 30 09:30:26 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:30:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:30:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 342c9729-6990-4f95-8d1e-6c3ba45a881c {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 21360976-bd14-407a-82f3-7543a1f052b3 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 978db29e-9a39-4638-ab8a-470768ccb4b2 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid f1271f7f-d3d0-4d07-b9ee-50592fc9de61 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "21360976-bd14-407a-82f3-7543a1f052b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "21360976-bd14-407a-82f3-7543a1f052b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:38 user nova-compute[75340]: INFO nova.compute.manager [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Terminating instance
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-80091707-ed24-4786-ad55-918030eea5e8 req-2937d9c4-50c1-4cd0-b47b-b0ed0bbb9b5b service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-unplugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Instance destroyed successfully.
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.objects.instance [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lazy-loading 'resources' on Instance uuid be9c04f6-a829-40a7-90aa-9de247e82875 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343741322',display_name='tempest-ServerStableDeviceRescueTest-server-1343741322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343741322',id=28,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK//0qfgJiAJATINPwpjaLe+8XrtpIroRuzvuqCk3Hbe1RPiMwJph2CAXpAXmLft/ZFSoluxkoSRKCDyp37zwJA1eCdsVckeSk3KzBwxnxelxiViAGU063NTV3weUycR3A==',key_name='tempest-keypair-427914405',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:27:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20c54b843022432bafa59fd390295051',ramdisk_id='',reservation_id='r-yi7ltvaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1657990061',owner_user_name='tempest-ServerStableDeviceRescueTest-1657990061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0f0a6a4a8584208ad2d68fed45b1690',uuid=be9c04f6-a829-40a7-90aa-9de247e82875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converting VIF {"id": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "address": "fa:16:3e:72:7a:1b", "network": {"id": "1957bc72-f581-4716-af7f-a6529952133e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1037573127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20c54b843022432bafa59fd390295051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d684f04-c5", "ovs_interfaceid": "6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG os_vif [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d684f04-c5, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=777c2adb-4ba4-4d96-9bae-41aa58c0f73f) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:38 user nova-compute[75340]: INFO os_vif [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7,network=Network(1957bc72-f581-4716-af7f-a6529952133e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d684f04-c5')
Nov 30 09:30:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Deleting instance files /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875_del
Nov 30 09:30:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Deletion of /opt/stack/data/nova/instances/be9c04f6-a829-40a7-90aa-9de247e82875_del complete
Nov 30 09:30:39 user nova-compute[75340]: INFO nova.compute.manager [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 09:30:39 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:30:39 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:30:39 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:30:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:40 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Took 1.02 seconds to deallocate network for instance.
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b4f9bcf-6983-496d-96c2-1fd690225677 req-e5758e30-cb9e-4c5f-b4af-f24276830264 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-deleted-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] Acquiring lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] Lock "be9c04f6-a829-40a7-90aa-9de247e82875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] No waiting events found dispatching network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:40 user nova-compute[75340]: WARNING nova.compute.manager [req-04c87798-6dab-4fad-aee0-5dc1ee3b5452 req-469a8d02-db55-4e28-a22e-2b3940b4fa72 service nova] [instance: be9c04f6-a829-40a7-90aa-9de247e82875] Received unexpected event network-vif-plugged-6d684f04-c5da-4b57-a2b8-c3d75cf0f5a7 for instance with vm_state deleted and task_state None.
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:40 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Deleted allocations for instance be9c04f6-a829-40a7-90aa-9de247e82875
Nov 30 09:30:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-bbfba062-6ee5-42e4-91a6-579debf2110c tempest-ServerStableDeviceRescueTest-1657990061 tempest-ServerStableDeviceRescueTest-1657990061-project-member] Lock "be9c04f6-a829-40a7-90aa-9de247e82875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.720s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:30:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:46 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 308ab353-749a-464b-affe-811f4292a492 is timed out.
Nov 30 09:30:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully detached device vdb from instance 308ab353-749a-464b-affe-811f4292a492 from the live domain config.
Nov 30 09:30:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRMoAnjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2250ef2-3613-4f3e-9317-e0a7a12778da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:30:46 user nova-compute[75340]: No targets found.
Nov 30 09:30:46 user nova-compute[75340]: iSNS:
Nov 30 09:30:46 user nova-compute[75340]: No targets found.
Nov 30 09:30:46 user nova-compute[75340]: STATIC:
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:30:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:46 user nova-compute[75340]: FIRMWARE:
Nov 30 09:30:46 user nova-compute[75340]: No targets found.
Nov 30 09:30:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:30:46 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:30:46 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9cfb4-b359-4d1e-a99a-63bfcfdfa916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20dfd64-8764-4d61-949e-436cb19c53dc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)
Nov 30 09:30:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:46 user nova-compute[75340]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb (non-flash)
Nov 30 09:30:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff501d2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb'): ({'sdg'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Removing single pathed devices sdg {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fde95-9c33-4af7-9edc-065d3cf62595]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b634dd4-e678-45e7-a98c-30eed3359ee0]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Flushing IO for device /dev/sdg {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59f921b-d5b6-4e69-b288-8c13b555e6d1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29cb91-ace2-4273-aa5f-c4accc38c45a]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] SCSI volumes sdg have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e9282b-28c2-4597-9700-b52ecdc682cd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a3f24e-d0f4-44fe-bacc-4eb4d2d57304]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260]
Nov 30 09:30:46 user nova-compute[75340]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb, portal: 172.16.0.220,3260] successful.
Nov 30 09:30:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68775839-d093-44a7-b295-f13151f0e3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9bc31-d518-412d-a754-3bd0f53d94f0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] <== disconnect_volume: return (376ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:30:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [{"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-21360976-bd14-407a-82f3-7543a1f052b3" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG nova.objects.instance [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'flavor' on Instance uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-03ae318e-3368-4dd1-829d-4e2ed727d7e5 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.569s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:50 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:30:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7206MB free_disk=24.94355010986328GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:55 user nova-compute[75340]: INFO nova.compute.manager [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Terminating instance
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 9c6c4ed4-4acc-4a24-bf80-820a72587045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 978db29e-9a39-4638-ab8a-470768ccb4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 308ab353-749a-464b-affe-811f4292a492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-f81f92e5-6ae3-4e97-8a8d-2e79cca7dad9 req-4a623f64-2190-47c1-8ee5-12d27d1bb1fe service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-unplugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:30:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Instance destroyed successfully.
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.objects.instance [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 0bbdc278-80bc-4c20-87fa-2675a63ea503 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1612015618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1612015618',id=31,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:27:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9hm7pqmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:29:10Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=0bbdc278-80bc-4c20-87fa-2675a63ea503,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "a9a06f25-b07d-48e1-979a-2151d4077150", "address": "fa:16:3e:3b:d7:3c", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a06f25-b0", "ovs_interfaceid": "a9a06f25-b07d-48e1-979a-2151d4077150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_vif [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9a06f25-b0, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa6c9d41-a66d-4a37-84e8-21605a95a878) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:30:56 user nova-compute[75340]: INFO os_vif [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d7:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9a06f25-b07d-48e1-979a-2151d4077150,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a06f25-b0')
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MftaXzmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:30:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afea74b-9183-4cd0-bc2b-5bb07f0b3f55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:30:56 user nova-compute[75340]: No targets found.
Nov 30 09:30:56 user nova-compute[75340]: iSNS:
Nov 30 09:30:56 user nova-compute[75340]: No targets found.
Nov 30 09:30:56 user nova-compute[75340]: STATIC:
Nov 30 09:30:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:30:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459
Nov 30 09:30:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:30:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:30:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:30:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:30:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:30:56 user nova-compute[75340]: FIRMWARE:
Nov 30 09:30:56 user nova-compute[75340]: No targets found.
Nov 30 09:30:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:30:56 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:30:56 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a286806-09e7-4a26-96e0-e0dfa119201e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63239c1-6981-49a3-bd81-5a9f1ae73781]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:30:56 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:30:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff3053e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459'): ({'sde'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Removing single pathed devices sde {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac18f1-a4e3-4bbd-99d3-0db1a65bee3a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6ff752-66e6-42d6-8207-6bfed792911e]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flushing IO for device /dev/sde {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3cc789-f104-4cf3-8fe3-673ba4b792cc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c719d603-0985-474d-ad40-2b16243fa71e]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] SCSI volumes sde have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b6872e22', '/dev/disk/by-id/scsi-26632386565393561', '/dev/disk/by-id/scsi-1SCST_BIOb6872e22-f28ee95a3af7044f') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:30:56 user nova-compute[75340]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b6872e22
Nov 30 09:30:56 user nova-compute[75340]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26632386565393561
Nov 30 09:30:56 user nova-compute[75340]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb6872e22-f28ee95a3af7044f
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f8b2cc-bcff-4914-bb2b-5b91027a3486]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb788893-719f-43b7-b6a2-5bcef340782c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --logout" returned: 0 in 0.121s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638e7a5-6cfd-4b8e-8d76-05817055d6bf]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260]
Nov 30 09:30:56 user nova-compute[75340]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459, portal: 172.16.0.220,3260] successful.
Nov 30 09:30:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950b54c0-8c82-4311-9245-3c8b55279459 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaadc360-a238-4a97-8105-330ad6eec134]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== disconnect_volume: return (404ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:30:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Deleting instance files /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503_del
Nov 30 09:30:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Deletion of /opt/stack/data/nova/instances/0bbdc278-80bc-4c20-87fa-2675a63ea503_del complete
Nov 30 09:30:56 user nova-compute[75340]: INFO nova.compute.manager [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:30:56 user nova-compute[75340]: INFO nova.compute.manager [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Unrescuing
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:30:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-96b9b4b4-f57c-46d4-a942-1e8848e5f17b req-95c573fd-5a87-4dba-a177-8a74f021aec6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-deleted-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:57 user nova-compute[75340]: INFO nova.compute.manager [req-96b9b4b4-f57c-46d4-a942-1e8848e5f17b req-95c573fd-5a87-4dba-a177-8a74f021aec6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Neutron deleted interface a9a06f25-b07d-48e1-979a-2151d4077150; detaching it from the instance and deleting it from the info cache
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-96b9b4b4-f57c-46d4-a942-1e8848e5f17b req-95c573fd-5a87-4dba-a177-8a74f021aec6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:57 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Took 0.54 seconds to deallocate network for instance.
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-96b9b4b4-f57c-46d4-a942-1e8848e5f17b req-95c573fd-5a87-4dba-a177-8a74f021aec6 service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Detach interface failed, port_id=a9a06f25-b07d-48e1-979a-2151d4077150, reason: Instance 0bbdc278-80bc-4c20-87fa-2675a63ea503 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'flavor' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] Acquiring lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] No waiting events found dispatching network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:57 user nova-compute[75340]: WARNING nova.compute.manager [req-5fae7079-7834-4c1a-89dd-c21bccb8200b req-d7cd8c31-d8ba-4b83-bbc9-5c443db64f4a service nova] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Received unexpected event network-vif-plugged-a9a06f25-b07d-48e1-979a-2151d4077150 for instance with vm_state active and task_state deleting.
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:57 user nova-compute[75340]: WARNING nova.compute.manager [req-f84245e7-5930-4c83-950e-258a32e30598 req-294f3b8b-9357-401c-8703-772a71f8865f service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:30:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:30:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:58 user nova-compute[75340]: INFO nova.compute.manager [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 0bbdc278-80bc-4c20-87fa-2675a63ea503] Took 0.86 seconds to detach 1 volumes for instance.
Nov 30 09:30:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:58 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance destroyed successfully.
Nov 30 09:30:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:30:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:30:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:58 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Deleted allocations for instance 0bbdc278-80bc-4c20-87fa-2675a63ea503
Nov 30 09:30:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-514971ff-1d7f-4ece-bf02-c8efc94f95df tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "0bbdc278-80bc-4c20-87fa-2675a63ea503" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.343s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:59 user nova-compute[75340]: WARNING nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:30:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:30:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:30:59 user nova-compute[75340]: WARNING nova.compute.manager [req-b5daffac-b1f0-4f1a-9a74-48c199cabab2 req-c5f37f27-429c-45ef-ba5a-a7bce0451c8e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state rescued and task_state unrescuing.
Nov 30 09:31:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ba730ad8-a8b8-460c-a155-5320edf32ba4 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:01 user nova-compute[75340]: WARNING nova.compute.manager [req-f7982215-539b-4273-8363-2d8b9d61d0db req-cff0614e-0b78-40c9-85ba-0239b3cbdf7e service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state active and task_state None.
Nov 30 09:31:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:31:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:12 user nova-compute[75340]: INFO nova.compute.manager [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Terminating instance
Nov 30 09:31:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:13 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbc750dd-cdbe-49ec-8fef-e214b72950f6 req-44852438-70d9-4999-936f-c3b9dfa25169 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-unplugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Instance destroyed successfully.
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'resources' on Instance uuid 9c6c4ed4-4acc-4a24-bf80-820a72587045 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1854362006',display_name='tempest-AttachVolumeTestJSON-server-1854362006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1854362006',id=25,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGlS+mAT1nBgUCl46gU7vXnENHlRPGKsuqK4S2UGg3SO7WcJThMBMi0PU77T/dA7SGuMgXRjrwq77ytk/cp7PL8V4tdVKzZtAvCmQ+s7OaTmv4d0Ey18wPt5eGLO5BKxA==',key_name='tempest-keypair-2020388238',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-j6uioac8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=9c6c4ed4-4acc-4a24-bf80-820a72587045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "c57b695b-790c-46f8-acab-abc09cccf781", "address": "fa:16:3e:d4:c0:a7", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc57b695b-79", "ovs_interfaceid": "c57b695b-790c-46f8-acab-abc09cccf781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG os_vif [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc57b695b-79, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a45d415-139f-48eb-9a08-fce5b88124fe) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:14 user nova-compute[75340]: INFO os_vif [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:a7,bridge_name='br-int',has_traffic_filtering=True,id=c57b695b-790c-46f8-acab-abc09cccf781,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc57b695b-79')
Nov 30 09:31:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Deleting instance files /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045_del
Nov 30 09:31:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Deletion of /opt/stack/data/nova/instances/9c6c4ed4-4acc-4a24-bf80-820a72587045_del complete
Nov 30 09:31:14 user nova-compute[75340]: INFO nova.compute.manager [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Took 2.45 seconds to destroy the instance on the hypervisor.
Nov 30 09:31:14 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:31:14 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:15 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Took 0.84 seconds to deallocate network for instance.
Nov 30 09:31:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-66175d21-5257-4b9c-9adc-b39858c609d0 req-55d24244-730c-4cc3-bf1b-5b9b03ba296f service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-deleted-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] Acquiring lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] No waiting events found dispatching network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:15 user nova-compute[75340]: WARNING nova.compute.manager [req-6b1dff35-b7f5-4874-98a6-0db38b78a745 req-e3c7feb4-7237-42f7-a3b9-16719c88aea6 service nova] [instance: 9c6c4ed4-4acc-4a24-bf80-820a72587045] Received unexpected event network-vif-plugged-c57b695b-790c-46f8-acab-abc09cccf781 for instance with vm_state active and task_state deleting.
Nov 30 09:31:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:16 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Deleted allocations for instance 9c6c4ed4-4acc-4a24-bf80-820a72587045
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-20d5fa1d-0b2f-493e-8925-df6a7954d463 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "9c6c4ed4-4acc-4a24-bf80-820a72587045" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.900s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "308ab353-749a-464b-affe-811f4292a492-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:16 user nova-compute[75340]: INFO nova.compute.manager [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Terminating instance
Nov 30 09:31:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-unplugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] Acquiring lock "308ab353-749a-464b-affe-811f4292a492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] No waiting events found dispatching network-vif-unplugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-f76fa055-d0a7-40c3-92c9-2f734dc2387c req-b283ae85-f225-41fd-b5c8-5976f05b338a service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-unplugged-d5808db1-a754-4fba-9767-485331d29836 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance destroyed successfully.
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'resources' on Instance uuid 308ab353-749a-464b-affe-811f4292a492 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-802808527',display_name='tempest-TestStampPattern-server-802808527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-802808527',id=37,image_ref='68802743-2aa5-4814-9715-3ea9218e770a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:28:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-bbhlr00b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='80eb22f8-9079-4cbe-8601-14a994c0b2e6',image_min_disk='1',image_min_ram='0',image_owner_id='113c291d956c434983f43ee4c9d85211',image_owner_project_name='tempest-TestStampPattern-30718589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-30718589-project-member',image_user_id='9a38f18b22334b9a94fbaebca2b89798',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:28:28Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=308ab353-749a-464b-affe-811f4292a492,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG os_vif [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5808db1-a7, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2801cf0a-7a72-4b49-8ae9-cdb91ee01544) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:17 user nova-compute[75340]: INFO os_vif [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0f:27,bridge_name='br-int',has_traffic_filtering=True,id=d5808db1-a754-4fba-9767-485331d29836,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5808db1-a7')
Nov 30 09:31:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Deleting instance files /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492_del
Nov 30 09:31:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Deletion of /opt/stack/data/nova/instances/308ab353-749a-464b-affe-811f4292a492_del complete
Nov 30 09:31:17 user nova-compute[75340]: INFO nova.compute.manager [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 308ab353-749a-464b-affe-811f4292a492] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 308ab353-749a-464b-affe-811f4292a492] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 308ab353-749a-464b-affe-811f4292a492] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-changed-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing instance network info cache due to event network-changed-d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] Acquiring lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] Acquired lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Refreshing network info cache for port d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:18 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 308ab353-749a-464b-affe-811f4292a492] Took 0.41 seconds to deallocate network for instance.
Nov 30 09:31:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updated VIF entry in instance network info cache for port d5808db1-a754-4fba-9767-485331d29836. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG nova.network.neutron [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Updating instance_info_cache with network_info: [{"id": "d5808db1-a754-4fba-9767-485331d29836", "address": "fa:16:3e:dd:0f:27", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5808db1-a7", "ovs_interfaceid": "d5808db1-a754-4fba-9767-485331d29836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-eb95480b-b2c1-4048-a767-199601290262 req-4ad8a386-4355-4048-ba19-db9c9a2d1034 service nova] Releasing lock "refresh_cache-308ab353-749a-464b-affe-811f4292a492" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:18 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Deleted allocations for instance 308ab353-749a-464b-affe-811f4292a492
Nov 30 09:31:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-56d487a3-96a7-4ee7-939a-d77588debcf6 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "308ab353-749a-464b-affe-811f4292a492" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] Acquiring lock "308ab353-749a-464b-affe-811f4292a492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] Lock "308ab353-749a-464b-affe-811f4292a492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] No waiting events found dispatching network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:19 user nova-compute[75340]: WARNING nova.compute.manager [req-227c9e0a-a5a1-41e2-84e6-1fb8af6c28ec req-1b8997de-2a69-4c09-b260-59d313469fe7 service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received unexpected event network-vif-plugged-d5808db1-a754-4fba-9767-485331d29836 for instance with vm_state deleted and task_state None.
Nov 30 09:31:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-0db0441d-69d2-4845-97cd-f646d7505e9a req-36d55459-5458-426c-b0ef-62b584147dcb service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Received event network-vif-deleted-d5808db1-a754-4fba-9767-485331d29836 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:19 user nova-compute[75340]: INFO nova.compute.manager [req-0db0441d-69d2-4845-97cd-f646d7505e9a req-36d55459-5458-426c-b0ef-62b584147dcb service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Neutron deleted interface d5808db1-a754-4fba-9767-485331d29836; detaching it from the instance and deleting it from the info cache
Nov 30 09:31:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-0db0441d-69d2-4845-97cd-f646d7505e9a req-36d55459-5458-426c-b0ef-62b584147dcb service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Instance is deleted, no further info cache update {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Nov 30 09:31:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-0db0441d-69d2-4845-97cd-f646d7505e9a req-36d55459-5458-426c-b0ef-62b584147dcb service nova] [instance: 308ab353-749a-464b-affe-811f4292a492] Detach interface failed, port_id=d5808db1-a754-4fba-9767-485331d29836, reason: Instance 308ab353-749a-464b-affe-811f4292a492 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:31:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:30 user nova-compute[75340]: INFO nova.compute.manager [None req-5d60f183-4620-4dd2-8d3e-a0e959466f1f tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Get console output
Nov 30 09:31:30 user nova-compute[75340]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 30 09:31:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing instance network info cache due to event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:31:41 user nova-compute[75340]: INFO nova.compute.claims [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Claim successful on node user
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:41 user nova-compute[75340]: INFO nova.compute.manager [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Shelve offloading
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updated VIF entry in instance network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4fe4e7a4-0c85-4106-ae1d-bdce3be9247a req-f0ea827e-2df3-4a36-b1e8-b8a3e461eaa0 service nova] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:31:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:31:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:42 user nova-compute[75340]: WARNING nova.compute.manager [req-d8a326f3-c202-4ede-ae07-827c2bd899d3 req-d6dbbb88-a102-4996-b2ee-234f469cc758 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state active and task_state shelving.
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.policy [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0b5fc1373bb4fc684250079452f64d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74110c7abaf346768e6072a0a20054eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:31:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Creating image(s)
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "/opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "/opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance destroyed successfully.
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk 1073741824" returned: 0 in 0.055s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Successfully created port: 96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Cannot resize image /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Ensure instance console log exists: /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Successfully updated port: 96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquired lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-changed-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Refreshing instance network info cache due to event network-changed-96ae019f-fe4b-4739-8bcd-697e10e57ff0. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] Acquiring lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:44 user nova-compute[75340]: WARNING nova.compute.manager [req-241bb929-baa4-4cfc-a6a1-b08bb39c46ba req-97ee56da-c97e-403e-bbec-b7c3b76a9f13 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state active and task_state shelving.
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updating instance_info_cache with network_info: [{"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Releasing lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Instance network_info: |[{"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] Acquired lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Refreshing network info cache for port 96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Start _get_guest_xml network_info=[{"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:31:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:44 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1368844',id=39,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9V1C3DIqUhqInmlyGHCsFQzNeRjHYMBKBzm+93OadGt1SDSYZ2DJA8OmshRTNorxWSRwJYzTtuTI/6q4dMRTm+mROtIt8MvkMcW6zWAN1pukG4aQeVk6QMl9q0ePde3A==',key_name='tempest-keypair-591454832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74110c7abaf346768e6072a0a20054eb',ramdisk_id='',reservation_id='r-gyhfn0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0b5fc1373bb4fc684250079452f64d9',uuid=fd49b4fa-b431-4846-b8d7-aa6913be4198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converting VIF {"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lazy-loading 'pci_devices' on Instance uuid fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:31:44 user nova-compute[75340]:   <uuid>fd49b4fa-b431-4846-b8d7-aa6913be4198</uuid>
Nov 30 09:31:44 user nova-compute[75340]:   <name>instance-00000027</name>
Nov 30 09:31:44 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:31:44 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:31:44 user nova-compute[75340]:   <metadata>
Nov 30 09:31:44 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:31:44 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071</nova:name>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:31:44</nova:creationTime>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:31:44 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:31:44 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:owner>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:user uuid="a0b5fc1373bb4fc684250079452f64d9">tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member</nova:user>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:project uuid="74110c7abaf346768e6072a0a20054eb">tempest-TestServerVolumeAttachScenarioOldVersion-715747441</nova:project>
Nov 30 09:31:44 user nova-compute[75340]:       </nova:owner>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:31:44 user nova-compute[75340]:       <nova:ports>
Nov 30 09:31:44 user nova-compute[75340]:         <nova:port uuid="96ae019f-fe4b-4739-8bcd-697e10e57ff0">
Nov 30 09:31:44 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 09:31:44 user nova-compute[75340]:         </nova:port>
Nov 30 09:31:44 user nova-compute[75340]:       </nova:ports>
Nov 30 09:31:44 user nova-compute[75340]:     </nova:instance>
Nov 30 09:31:44 user nova-compute[75340]:   </metadata>
Nov 30 09:31:44 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:31:44 user nova-compute[75340]:     <system>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="serial">fd49b4fa-b431-4846-b8d7-aa6913be4198</entry>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="uuid">fd49b4fa-b431-4846-b8d7-aa6913be4198</entry>
Nov 30 09:31:44 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:31:44 user nova-compute[75340]:     </system>
Nov 30 09:31:44 user nova-compute[75340]:   </sysinfo>
Nov 30 09:31:44 user nova-compute[75340]:   <os>
Nov 30 09:31:44 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:31:44 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:31:44 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:31:44 user nova-compute[75340]:   </os>
Nov 30 09:31:44 user nova-compute[75340]:   <features>
Nov 30 09:31:44 user nova-compute[75340]:     <acpi/>
Nov 30 09:31:44 user nova-compute[75340]:     <apic/>
Nov 30 09:31:44 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:31:44 user nova-compute[75340]:   </features>
Nov 30 09:31:44 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:31:44 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:31:44 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:31:44 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:31:44 user nova-compute[75340]:   </clock>
Nov 30 09:31:44 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:31:44 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:31:44 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:31:44 user nova-compute[75340]:   </cpu>
Nov 30 09:31:44 user nova-compute[75340]:   <devices>
Nov 30 09:31:44 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:31:44 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:31:44 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk"/>
Nov 30 09:31:44 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:31:44 user nova-compute[75340]:     </disk>
Nov 30 09:31:44 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:31:44 user nova-compute[75340]:       <mac address="fa:16:3e:a5:05:a8"/>
Nov 30 09:31:44 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:31:44 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:31:44 user nova-compute[75340]:       <target dev="tap96ae019f-fe"/>
Nov 30 09:31:44 user nova-compute[75340]:     </interface>
Nov 30 09:31:44 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:31:44 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/console.log" append="off"/>
Nov 30 09:31:44 user nova-compute[75340]:     </serial>
Nov 30 09:31:44 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:31:44 user nova-compute[75340]:     <video>
Nov 30 09:31:44 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:31:44 user nova-compute[75340]:     </video>
Nov 30 09:31:44 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:31:44 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:31:44 user nova-compute[75340]:     </rng>
Nov 30 09:31:44 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:31:44 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:31:44 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:31:44 user nova-compute[75340]:     </memballoon>
Nov 30 09:31:44 user nova-compute[75340]:   </devices>
Nov 30 09:31:44 user nova-compute[75340]: </domain>
Nov 30 09:31:44 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1368844',id=39,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9V1C3DIqUhqInmlyGHCsFQzNeRjHYMBKBzm+93OadGt1SDSYZ2DJA8OmshRTNorxWSRwJYzTtuTI/6q4dMRTm+mROtIt8MvkMcW6zWAN1pukG4aQeVk6QMl9q0ePde3A==',key_name='tempest-keypair-591454832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74110c7abaf346768e6072a0a20054eb',ramdisk_id='',reservation_id='r-gyhfn0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0b5fc1373bb4fc684250079452f64d9',uuid=fd49b4fa-b431-4846-b8d7-aa6913be4198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converting VIF {"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_vif [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b1894b-fd59-5da2-876c-b6b364560dc3', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance destroyed successfully.
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'resources' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ae019f-fe, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96ae019f-fe, col_values=(('qos', UUID('f8d36ed6-2421-438d-aed6-bdc2a98cd6b0')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96ae019f-fe, col_values=(('external_ids', {'iface-id': '96ae019f-fe4b-4739-8bcd-697e10e57ff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:05:a8', 'vm-uuid': 'fd49b4fa-b431-4846-b8d7-aa6913be4198'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: INFO os_vif [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe')
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4tX1juoszHD+LgbJiLCUWaNOcoqhH5w5hk17UFwDFfUS/9EREkMw42nljfwLj3/IkcRNpJnl0isRswatJxczgJ13HEsFrQPFPiUvjn71dOpijedxa2rYoeQeKWSPPf9Q==',key_name='tempest-TestShelveInstance-1377343270',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:30:07Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_vif [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87c43f9-1b, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0429eb23-49bb-4c44-8cd8-d00600c3184b) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: INFO os_vif [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b')
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:31:44 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908df1d-c8fc-403e-a19f-27048f75d59f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:31:44 user nova-compute[75340]: No targets found.
Nov 30 09:31:44 user nova-compute[75340]: iSNS:
Nov 30 09:31:44 user nova-compute[75340]: No targets found.
Nov 30 09:31:44 user nova-compute[75340]: STATIC:
Nov 30 09:31:44 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:31:44 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:31:44 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:31:44 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:31:44 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:31:44 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:31:44 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:31:44 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:31:44 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:31:44 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:31:44 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:31:44 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:31:44 user nova-compute[75340]: FIRMWARE:
Nov 30 09:31:44 user nova-compute[75340]: No targets found.
Nov 30 09:31:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:31:44 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:31:44 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] No VIF found with MAC fa:16:3e:a5:05:a8, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae9e898-e77e-4e33-b89e-045b4889dab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc3ccf8-2556-48c9-b35a-91e8c1cf469b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:31:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:31:44 user nova-compute[75340]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:31:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[81067bbf-e442-4b33-9f4b-fdecf16ae260]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807b7bb-5cf6-4f51-aa23-7e9b3a00a2bb]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b11df-427d-439c-a140-8b1618cd3ba0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d0ff26-da40-484f-b28d-142bbc1dc310]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c1240f-646a-4122-8b78-2fe0242d3a4a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285667a-1e43-4d1a-a7d0-68f33a7a49bf]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]
Nov 30 09:31:44 user nova-compute[75340]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.
Nov 30 09:31:44 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59fe456-e982-4741-b2ed-629e94b2309c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== disconnect_volume: return (380ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:31:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deleting instance files /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7_del
Nov 30 09:31:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deletion of /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7_del complete
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updated VIF entry in instance network info cache for port 96ae019f-fe4b-4739-8bcd-697e10e57ff0. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updating instance_info_cache with network_info: [{"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e60d9850-665c-4303-ba29-2143cadcb7c1 req-173df67d-e368-4079-b1f2-a53787a777b1 service nova] Releasing lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing instance network info cache due to event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:45 user nova-compute[75340]: INFO nova.compute.manager [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Terminating instance
Nov 30 09:31:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Deleted allocations for instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'numa_topology' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.objects.base [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Object Instance<06803cbd-89e9-40c6-90fe-cdb61836e4d7> lazy-loaded attributes: resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] No waiting events found dispatching network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:46 user nova-compute[75340]: WARNING nova.compute.manager [req-c4e50c22-e263-4116-af96-27c68c8cf3d1 req-51497ca0-5fe1-4322-aa64-54b81d7acc81 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received unexpected event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 for instance with vm_state building and task_state spawning.
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.neutron [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updated VIF entry in instance network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.neutron [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": null, "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape87c43f9-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f12978db-8dca-4b6e-b96c-c9e8ca5ba68c req-7627847c-dd41-4066-9029-c89f5d18c2bb service nova] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Instance destroyed successfully.
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 978db29e-9a39-4638-ab8a-470768ccb4b2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-847229174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-847229174',id=26,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-m60v8397',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:24:19Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=978db29e-9a39-4638-ab8a-470768ccb4b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "57822f08-e975-4788-83f2-e45e06d673e1", "address": "fa:16:3e:c3:64:c3", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57822f08-e9", "ovs_interfaceid": "57822f08-e975-4788-83f2-e45e06d673e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG os_vif [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57822f08-e9, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77ad3a46-3cba-4d94-828c-a6a2031fb798) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:46 user nova-compute[75340]: INFO os_vif [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:c3,bridge_name='br-int',has_traffic_filtering=True,id=57822f08-e975-4788-83f2-e45e06d673e1,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57822f08-e9')
Nov 30 09:31:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Deleting instance files /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2_del
Nov 30 09:31:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Deletion of /opt/stack/data/nova/instances/978db29e-9a39-4638-ab8a-470768ccb4b2_del complete
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cb5bb58b-592c-4d03-becb-f6f5cbcde945 tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.230s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:31:46 user nova-compute[75340]: INFO nova.compute.manager [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 09:31:46 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:31:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:47 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Took 0.59 seconds to deallocate network for instance.
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [{"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3f707e1f-21fa-4122-94ee-7eb3f28df193" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] Acquiring lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] No waiting events found dispatching network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:47 user nova-compute[75340]: WARNING nova.compute.manager [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received unexpected event network-vif-plugged-57822f08-e975-4788-83f2-e45e06d673e1 for instance with vm_state deleted and task_state None.
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-a61333da-ec84-4faa-882b-ded4c18bd96a req-d3484972-2470-4243-b549-35acf8db3145 service nova] [instance: 978db29e-9a39-4638-ab8a-470768ccb4b2] Received event network-vif-deleted-57822f08-e975-4788-83f2-e45e06d673e1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:47 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:48 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Deleted allocations for instance 978db29e-9a39-4638-ab8a-470768ccb4b2
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3abc2f6e-885a-4aec-89c2-ba046c33d9a4 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "978db29e-9a39-4638-ab8a-470768ccb4b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] No waiting events found dispatching network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:48 user nova-compute[75340]: WARNING nova.compute.manager [req-a556fa8d-8a06-4b19-b0ce-1739c61669cb req-67d7cf70-cf3c-4ae9-ad7c-b646c9bcca59 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received unexpected event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 for instance with vm_state building and task_state spawning.
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:31:48 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Instance spawned successfully.
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:48 user nova-compute[75340]: INFO nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 30 09:31:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:31:48 user nova-compute[75340]: INFO nova.compute.manager [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Took 7.51 seconds to build instance.
Nov 30 09:31:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-12c92635-d7c2-46cc-8111-5cb2ce16a8e5 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.635s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:50 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:31:50 user nova-compute[75340]: INFO nova.compute.claims [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Claim successful on node user
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:31:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:31:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Creating image(s)
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.policy [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34a31aeeca154620ba74acbaaabcdced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a6d95b1ed43879eca5e07be0a4276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.251s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.190s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk 1073741824" returned: 0 in 0.056s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Cannot resize image /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Ensure instance console log exists: /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Successfully created port: bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Successfully updated port: bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing instance network info cache due to event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:31:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.neutron [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.neutron [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-30601e00-9546-4ee7-85a5-260c1d8b0b64 req-c3d399a6-2e1a-4be0-a246-e1ff42d80b18 service nova] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance network_info: |[{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start _get_guest_xml network_info=[{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:31:53 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:53 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPAuePxfVK9KzfjPCWK5pwa924BGsv9d0OXvzlR5J/iQjHOCHafLlE0ynMfVMhm0AamVDyJ7pS73pxeQ0DQok4lzTIo8Chv/rcVlWP5i7BHAbB7/+pcGT1QgmgAl2kvjQ==',key_name='tempest-keypair-264695344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_devices' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:31:53 user nova-compute[75340]:   <uuid>c3814f52-db11-4fb4-b272-c5cf794511f2</uuid>
Nov 30 09:31:53 user nova-compute[75340]:   <name>instance-00000028</name>
Nov 30 09:31:53 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:31:53 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:31:53 user nova-compute[75340]:   <metadata>
Nov 30 09:31:53 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:31:53 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1975615668</nova:name>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:31:53</nova:creationTime>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:31:53 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:31:53 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:owner>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:user uuid="34a31aeeca154620ba74acbaaabcdced">tempest-AttachVolumeShelveTestJSON-1052742553-project-member</nova:user>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:project uuid="a90a6d95b1ed43879eca5e07be0a4276">tempest-AttachVolumeShelveTestJSON-1052742553</nova:project>
Nov 30 09:31:53 user nova-compute[75340]:       </nova:owner>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:31:53 user nova-compute[75340]:       <nova:ports>
Nov 30 09:31:53 user nova-compute[75340]:         <nova:port uuid="bc9cdba3-3512-49eb-9fdc-29711f03c709">
Nov 30 09:31:53 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 09:31:53 user nova-compute[75340]:         </nova:port>
Nov 30 09:31:53 user nova-compute[75340]:       </nova:ports>
Nov 30 09:31:53 user nova-compute[75340]:     </nova:instance>
Nov 30 09:31:53 user nova-compute[75340]:   </metadata>
Nov 30 09:31:53 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:31:53 user nova-compute[75340]:     <system>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="serial">c3814f52-db11-4fb4-b272-c5cf794511f2</entry>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="uuid">c3814f52-db11-4fb4-b272-c5cf794511f2</entry>
Nov 30 09:31:53 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:31:53 user nova-compute[75340]:     </system>
Nov 30 09:31:53 user nova-compute[75340]:   </sysinfo>
Nov 30 09:31:53 user nova-compute[75340]:   <os>
Nov 30 09:31:53 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:31:53 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:31:53 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:31:53 user nova-compute[75340]:   </os>
Nov 30 09:31:53 user nova-compute[75340]:   <features>
Nov 30 09:31:53 user nova-compute[75340]:     <acpi/>
Nov 30 09:31:53 user nova-compute[75340]:     <apic/>
Nov 30 09:31:53 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:31:53 user nova-compute[75340]:   </features>
Nov 30 09:31:53 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:31:53 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:31:53 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:31:53 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:31:53 user nova-compute[75340]:   </clock>
Nov 30 09:31:53 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:31:53 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:31:53 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:31:53 user nova-compute[75340]:   </cpu>
Nov 30 09:31:53 user nova-compute[75340]:   <devices>
Nov 30 09:31:53 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:31:53 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:31:53 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk"/>
Nov 30 09:31:53 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:31:53 user nova-compute[75340]:     </disk>
Nov 30 09:31:53 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:31:53 user nova-compute[75340]:       <mac address="fa:16:3e:96:a7:c0"/>
Nov 30 09:31:53 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:31:53 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:31:53 user nova-compute[75340]:       <target dev="tapbc9cdba3-35"/>
Nov 30 09:31:53 user nova-compute[75340]:     </interface>
Nov 30 09:31:53 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:31:53 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/console.log" append="off"/>
Nov 30 09:31:53 user nova-compute[75340]:     </serial>
Nov 30 09:31:53 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:31:53 user nova-compute[75340]:     <video>
Nov 30 09:31:53 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:31:53 user nova-compute[75340]:     </video>
Nov 30 09:31:53 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:31:53 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:31:53 user nova-compute[75340]:     </rng>
Nov 30 09:31:53 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:31:53 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:31:53 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:31:53 user nova-compute[75340]:     </memballoon>
Nov 30 09:31:53 user nova-compute[75340]:   </devices>
Nov 30 09:31:53 user nova-compute[75340]: </domain>
Nov 30 09:31:53 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPAuePxfVK9KzfjPCWK5pwa924BGsv9d0OXvzlR5J/iQjHOCHafLlE0ynMfVMhm0AamVDyJ7pS73pxeQ0DQok4lzTIo8Chv/rcVlWP5i7BHAbB7/+pcGT1QgmgAl2kvjQ==',key_name='tempest-keypair-264695344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG os_vif [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7632ef-9f37-5cac-b094-c800226beb0b', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9cdba3-35, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9cdba3-35, col_values=(('qos', UUID('a31384c0-23c2-46c8-9934-716249067369')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9cdba3-35, col_values=(('external_ids', {'iface-id': 'bc9cdba3-3512-49eb-9fdc-29711f03c709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:a7:c0', 'vm-uuid': 'c3814f52-db11-4fb4-b272-c5cf794511f2'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:53 user nova-compute[75340]: INFO os_vif [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35')
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No VIF found with MAC fa:16:3e:96:a7:c0, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:57 user nova-compute[75340]: WARNING nova.compute.manager [req-26887a9f-10a8-4935-b06b-6af1cd906dbe req-dd897719-f446-43ec-80fd-57176403def9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state building and task_state spawning.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:31:57 user nova-compute[75340]: WARNING nova.compute.manager [req-e96ec9a6-90d0-4b67-a698-7d70974d5360 req-f6be6c1b-a6ae-43fe-b736-e63b9330f493 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state building and task_state spawning.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:31:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance spawned successfully.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:31:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.06775665283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:31:57 user nova-compute[75340]: INFO nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fd49b4fa-b431-4846-b8d7-aa6913be4198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c3814f52-db11-4fb4-b272-c5cf794511f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:31:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:31:57 user nova-compute[75340]: INFO nova.compute.manager [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Took 7.12 seconds to build instance.
Nov 30 09:31:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb5c-123c-493a-9772-83c1df2837c2 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.225s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:31:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:31:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:31:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:31:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:31:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:31:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:32:06 user nova-compute[75340]: INFO nova.compute.claims [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Claim successful on node user
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:32:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.policy [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d13c8d8c984172a828f34deb3f9bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca9314cdc634dfa9df097fcd53c2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:32:07 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Creating image(s)
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "/opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "/opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk 1073741824" returned: 0 in 0.077s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Successfully created port: 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.215s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Cannot resize image /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Ensure instance console log exists: /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Successfully updated port: 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquired lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-changed-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Refreshing instance network info cache due to event network-changed-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] Acquiring lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:32:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.neutron [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating instance_info_cache with network_info: [{"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Releasing lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Instance network_info: |[{"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] Acquired lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Refreshing network info cache for port 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Start _get_guest_xml network_info=[{"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:32:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:32:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2113409725',display_name='tempest-AttachVolumeTestJSON-server-2113409725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2113409725',id=41,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPFEiBYHdvFNzknqAvuHIjMulTH73kYG5sX57equ6KRJkJRwHm00Fty7tHz6/knGi8TOwPtGW3l2upBxBQuQLKzNuAuuYX5uI/D7oBsYNTJRQrCbxwe1yckwLEVlBXThw==',key_name='tempest-keypair-346445318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-6wkqru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=8d552527-2746-4f2d-9f50-4dbbf34558e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.objects.instance [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:32:09 user nova-compute[75340]:   <uuid>8d552527-2746-4f2d-9f50-4dbbf34558e7</uuid>
Nov 30 09:32:09 user nova-compute[75340]:   <name>instance-00000029</name>
Nov 30 09:32:09 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:32:09 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:32:09 user nova-compute[75340]:   <metadata>
Nov 30 09:32:09 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:32:09 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeTestJSON-server-2113409725</nova:name>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:32:09</nova:creationTime>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:32:09 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:32:09 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:owner>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:user uuid="82d13c8d8c984172a828f34deb3f9bf6">tempest-AttachVolumeTestJSON-158840588-project-member</nova:user>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:project uuid="cca9314cdc634dfa9df097fcd53c2c2c">tempest-AttachVolumeTestJSON-158840588</nova:project>
Nov 30 09:32:09 user nova-compute[75340]:       </nova:owner>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:32:09 user nova-compute[75340]:       <nova:ports>
Nov 30 09:32:09 user nova-compute[75340]:         <nova:port uuid="9fb0fd9a-ffb2-412e-a524-8fe23cbb0399">
Nov 30 09:32:09 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 09:32:09 user nova-compute[75340]:         </nova:port>
Nov 30 09:32:09 user nova-compute[75340]:       </nova:ports>
Nov 30 09:32:09 user nova-compute[75340]:     </nova:instance>
Nov 30 09:32:09 user nova-compute[75340]:   </metadata>
Nov 30 09:32:09 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:32:09 user nova-compute[75340]:     <system>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="serial">8d552527-2746-4f2d-9f50-4dbbf34558e7</entry>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="uuid">8d552527-2746-4f2d-9f50-4dbbf34558e7</entry>
Nov 30 09:32:09 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:32:09 user nova-compute[75340]:     </system>
Nov 30 09:32:09 user nova-compute[75340]:   </sysinfo>
Nov 30 09:32:09 user nova-compute[75340]:   <os>
Nov 30 09:32:09 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:32:09 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:32:09 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:32:09 user nova-compute[75340]:   </os>
Nov 30 09:32:09 user nova-compute[75340]:   <features>
Nov 30 09:32:09 user nova-compute[75340]:     <acpi/>
Nov 30 09:32:09 user nova-compute[75340]:     <apic/>
Nov 30 09:32:09 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:32:09 user nova-compute[75340]:   </features>
Nov 30 09:32:09 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:32:09 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:32:09 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:32:09 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:32:09 user nova-compute[75340]:   </clock>
Nov 30 09:32:09 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:32:09 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:32:09 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:32:09 user nova-compute[75340]:   </cpu>
Nov 30 09:32:09 user nova-compute[75340]:   <devices>
Nov 30 09:32:09 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:32:09 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:32:09 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk"/>
Nov 30 09:32:09 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:32:09 user nova-compute[75340]:     </disk>
Nov 30 09:32:09 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:32:09 user nova-compute[75340]:       <mac address="fa:16:3e:05:15:5b"/>
Nov 30 09:32:09 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:32:09 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:32:09 user nova-compute[75340]:       <target dev="tap9fb0fd9a-ff"/>
Nov 30 09:32:09 user nova-compute[75340]:     </interface>
Nov 30 09:32:09 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:32:09 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/console.log" append="off"/>
Nov 30 09:32:09 user nova-compute[75340]:     </serial>
Nov 30 09:32:09 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:32:09 user nova-compute[75340]:     <video>
Nov 30 09:32:09 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:32:09 user nova-compute[75340]:     </video>
Nov 30 09:32:09 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:32:09 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:32:09 user nova-compute[75340]:     </rng>
Nov 30 09:32:09 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:32:09 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:32:09 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:32:09 user nova-compute[75340]:     </memballoon>
Nov 30 09:32:09 user nova-compute[75340]:   </devices>
Nov 30 09:32:09 user nova-compute[75340]: </domain>
Nov 30 09:32:09 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2113409725',display_name='tempest-AttachVolumeTestJSON-server-2113409725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2113409725',id=41,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPFEiBYHdvFNzknqAvuHIjMulTH73kYG5sX57equ6KRJkJRwHm00Fty7tHz6/knGi8TOwPtGW3l2upBxBQuQLKzNuAuuYX5uI/D7oBsYNTJRQrCbxwe1yckwLEVlBXThw==',key_name='tempest-keypair-346445318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-6wkqru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=8d552527-2746-4f2d-9f50-4dbbf34558e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG os_vif [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6320c090-481d-5dc2-9af9-dcfc73a8ddc4', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb0fd9a-ff, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fb0fd9a-ff, col_values=(('qos', UUID('4a04b216-2d95-4ec3-b526-50435b4fef9e')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fb0fd9a-ff, col_values=(('external_ids', {'iface-id': '9fb0fd9a-ffb2-412e-a524-8fe23cbb0399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:15:5b', 'vm-uuid': '8d552527-2746-4f2d-9f50-4dbbf34558e7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:09 user nova-compute[75340]: INFO os_vif [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff')
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No VIF found with MAC fa:16:3e:05:15:5b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updated VIF entry in instance network info cache for port 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG nova.network.neutron [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating instance_info_cache with network_info: [{"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-34c677cc-7064-4696-b68e-a8045ee45fb8 req-55e08abc-6763-4e63-a2a7-bbe59d733b1f service nova] Releasing lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] No waiting events found dispatching network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:10 user nova-compute[75340]: WARNING nova.compute.manager [req-0f241cc4-b36a-46ff-bff4-ad55a1dbc9b7 req-db3e214b-b814-4351-b0e3-f986a46c5ad1 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received unexpected event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 for instance with vm_state building and task_state spawning.
Nov 30 09:32:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] No waiting events found dispatching network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:12 user nova-compute[75340]: WARNING nova.compute.manager [req-e4e1cbf8-3754-45a4-a5e4-aa5f8b348e95 req-1acaaf1c-1654-42b2-ba27-8741a91906a3 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received unexpected event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 for instance with vm_state building and task_state spawning.
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:32:12 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Instance spawned successfully.
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:32:13 user nova-compute[75340]: INFO nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 30 09:32:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:32:13 user nova-compute[75340]: INFO nova.compute.manager [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Took 6.44 seconds to build instance.
Nov 30 09:32:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-49bc4347-781f-4b17-a5d4-a032585f9f61 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.734s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-changed-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:16 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing instance network info cache due to event network-changed-456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:32:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] Acquiring lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] Acquired lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:16 user nova-compute[75340]: DEBUG nova.network.neutron [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Refreshing network info cache for port 456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:17 user nova-compute[75340]: INFO nova.compute.manager [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Terminating instance
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-unplugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] No waiting events found dispatching network-vif-unplugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-ea490bda-df0c-4d05-b391-d9b250202b5e req-1ddc28b5-cee6-4e02-9136-465eabbbf345 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-unplugged-456bc463-66fd-42b4-9649-daf119172040 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updated VIF entry in instance network info cache for port 456bc463-66fd-42b4-9649-daf119172040. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.network.neutron [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating instance_info_cache with network_info: [{"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbf30d84-4c67-4cab-afb7-f978729e7b1b req-d7141f55-874a-4bb5-925d-456bef6b0f73 service nova] Releasing lock "refresh_cache-80eb22f8-9079-4cbe-8601-14a994c0b2e6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Instance destroyed successfully.
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lazy-loading 'resources' on Instance uuid 80eb22f8-9079-4cbe-8601-14a994c0b2e6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-493252871',display_name='tempest-TestStampPattern-server-493252871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493252871',id=30,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWfAXeGWODphibr48dl2dv/qCTQxtl4DnstRUFG2dWoZejw/xttkADQQXM7fkr1E6c1p7sCY+GlRMwtdF+ejqu3uPPDAg4Q9LUIVKa1/FFwqF/bNc7kTxjilVM4Y05vRg==',key_name='tempest-TestStampPattern-817007436',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113c291d956c434983f43ee4c9d85211',ramdisk_id='',reservation_id='r-5643ha6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-30718589',owner_user_name='tempest-TestStampPattern-30718589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:28:18Z,user_data=None,user_id='9a38f18b22334b9a94fbaebca2b89798',uuid=80eb22f8-9079-4cbe-8601-14a994c0b2e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converting VIF {"id": "456bc463-66fd-42b4-9649-daf119172040", "address": "fa:16:3e:b0:ca:a2", "network": {"id": "e649cea3-9f48-4d17-a7ad-02f6687d799a", "bridge": "br-int", "label": "tempest-TestStampPattern-717058173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113c291d956c434983f43ee4c9d85211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap456bc463-66", "ovs_interfaceid": "456bc463-66fd-42b4-9649-daf119172040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG os_vif [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap456bc463-66, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=925ca56d-111b-40b2-93c9-b214ea108277) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:17 user nova-compute[75340]: INFO os_vif [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:ca:a2,bridge_name='br-int',has_traffic_filtering=True,id=456bc463-66fd-42b4-9649-daf119172040,network=Network(e649cea3-9f48-4d17-a7ad-02f6687d799a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap456bc463-66')
Nov 30 09:32:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Deleting instance files /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6_del
Nov 30 09:32:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Deletion of /opt/stack/data/nova/instances/80eb22f8-9079-4cbe-8601-14a994c0b2e6_del complete
Nov 30 09:32:17 user nova-compute[75340]: INFO nova.compute.manager [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 09:32:17 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:32:17 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:32:18 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:18 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Took 0.44 seconds to deallocate network for instance.
Nov 30 09:32:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:18 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:32:18 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:32:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:18 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Deleted allocations for instance 80eb22f8-9079-4cbe-8601-14a994c0b2e6
Nov 30 09:32:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c3d366bb-ae60-410c-8e50-01a1f17c5b79 tempest-TestStampPattern-30718589 tempest-TestStampPattern-30718589-project-member] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.070s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] Acquiring lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] Lock "80eb22f8-9079-4cbe-8601-14a994c0b2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] No waiting events found dispatching network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:19 user nova-compute[75340]: WARNING nova.compute.manager [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received unexpected event network-vif-plugged-456bc463-66fd-42b4-9649-daf119172040 for instance with vm_state deleted and task_state None.
Nov 30 09:32:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-ed55d5a9-d0af-459f-be6c-078b1175c3f5 req-8b8685d1-d76a-4ed5-b41a-7423f268b1dd service nova] [instance: 80eb22f8-9079-4cbe-8601-14a994c0b2e6] Received event network-vif-deleted-456bc463-66fd-42b4-9649-daf119172040 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:31 user nova-compute[75340]: INFO nova.compute.manager [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Terminating instance
Nov 30 09:32:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-8b77de38-b740-4175-b49a-5545e796e0c5 req-734f8063-8852-4628-a291-4aa29bb894ae service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-unplugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Instance destroyed successfully.
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.objects.instance [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'resources' on Instance uuid f1271f7f-d3d0-4d07-b9ee-50592fc9de61 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-290554714',display_name='tempest-ServerActionsTestOtherA-server-290554714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-290554714',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-u5yz50z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=f1271f7f-d3d0-4d07-b9ee-50592fc9de61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "8b41d275-a828-4889-9d37-7ced21f5f610", "address": "fa:16:3e:d9:b2:d8", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b41d275-a8", "ovs_interfaceid": "8b41d275-a828-4889-9d37-7ced21f5f610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_vif [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b41d275-a8, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07f05f87-a4d3-446e-85ed-61fd9c333176) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:32 user nova-compute[75340]: INFO os_vif [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b2:d8,bridge_name='br-int',has_traffic_filtering=True,id=8b41d275-a828-4889-9d37-7ced21f5f610,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b41d275-a8')
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsbXIrjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:32:32 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1fe2c6-29ae-404f-a4d3-32570eb6e316]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:32:32 user nova-compute[75340]: No targets found.
Nov 30 09:32:32 user nova-compute[75340]: iSNS:
Nov 30 09:32:32 user nova-compute[75340]: No targets found.
Nov 30 09:32:32 user nova-compute[75340]: STATIC:
Nov 30 09:32:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:32:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:32:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:32:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae
Nov 30 09:32:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:32:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:32:32 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:32:32 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:32:32 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:32:32 user nova-compute[75340]: FIRMWARE:
Nov 30 09:32:32 user nova-compute[75340]: No targets found.
Nov 30 09:32:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:32:32 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:32:32 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f7cfb-0b6e-49f0-bf9d-250404da1a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea3b32-8d07-4c44-850f-a9b46fbf6800]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:32:32 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:32:32 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:32:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:32:32 user nova-compute[75340]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae (non-flash)
Nov 30 09:32:32 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:32:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307eb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11c7944-b7a5-4457-96bb-808133328318]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9a7bb-943f-420c-960d-7499674b0e1a]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdfb39a-0056-4994-aeed-3e08b3a13968]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.075s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[16467e0f-78da-4af0-9d21-fcfc964ffd28]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4631772d-d6f2-474f-ba53-a7fc141677e8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ed49e-7bb8-46a0-b8c7-d7ba1469d459]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260]
Nov 30 09:32:32 user nova-compute[75340]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae, portal: 172.16.0.220,3260] successful.
Nov 30 09:32:32 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a841f5-f0f8-4894-96ab-b144633ccfae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f22a21-8a76-492b-8f30-ab04956db17f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] <== disconnect_volume: return (385ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:32:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Deleting instance files /opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61_del
Nov 30 09:32:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Deletion of /opt/stack/data/nova/instances/f1271f7f-d3d0-4d07-b9ee-50592fc9de61_del complete
Nov 30 09:32:32 user nova-compute[75340]: INFO nova.compute.manager [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 30 09:32:32 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:32:32 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:33 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Took 0.91 seconds to deallocate network for instance.
Nov 30 09:32:33 user nova-compute[75340]: DEBUG nova.compute.manager [req-350860d1-0b53-4de5-8858-c381a6d1f446 req-8b6336b1-932d-45a0-afed-d3a0bd5979f2 service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-deleted-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG nova.compute.manager [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] Acquiring lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:33 user nova-compute[75340]: DEBUG nova.compute.manager [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] No waiting events found dispatching network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:33 user nova-compute[75340]: WARNING nova.compute.manager [req-714366da-e99e-4356-89b5-e62142408e5f req-f885160e-b077-4f3d-901d-b1446b86726d service nova] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Received unexpected event network-vif-plugged-8b41d275-a828-4889-9d37-7ced21f5f610 for instance with vm_state active and task_state deleting.
Nov 30 09:32:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:36 user nova-compute[75340]: INFO nova.compute.manager [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Took 2.67 seconds to detach 1 volumes for instance.
Nov 30 09:32:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: f1271f7f-d3d0-4d07-b9ee-50592fc9de61] Deleting volume: 50a841f5-f0f8-4894-96ab-b144633ccfae {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:36 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Deleted allocations for instance f1271f7f-d3d0-4d07-b9ee-50592fc9de61
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:36 user nova-compute[75340]: INFO nova.compute.manager [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Terminating instance
Nov 30 09:32:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-06a23401-c0e7-4171-a688-adb3e8a5a639 tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "f1271f7f-d3d0-4d07-b9ee-50592fc9de61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.555s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.compute.manager [req-8449a62f-dcbf-436e-8246-b6e610614456 req-a50c98dc-67f9-4faf-aae0-285d1601cb86 service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-unplugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Instance destroyed successfully.
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.objects.instance [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 3f707e1f-21fa-4122-94ee-7eb3f28df193 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1987351367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1987351367',id=15,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-k2ynkn0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:36Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=3f707e1f-21fa-4122-94ee-7eb3f28df193,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "566ae665-b699-43cb-8d13-55fd4866990a", "address": "fa:16:3e:ae:90:b9", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566ae665-b6", "ovs_interfaceid": "566ae665-b699-43cb-8d13-55fd4866990a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_vif [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap566ae665-b6, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97515ea3-7a28-41e2-8563-9ff2fcd95250) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:37 user nova-compute[75340]: INFO os_vif [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:90:b9,bridge_name='br-int',has_traffic_filtering=True,id=566ae665-b699-43cb-8d13-55fd4866990a,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566ae665-b6')
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShcrkPlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:32:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a84471-5ead-4bcb-ba9d-401d3fb203d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:32:37 user nova-compute[75340]: No targets found.
Nov 30 09:32:37 user nova-compute[75340]: iSNS:
Nov 30 09:32:37 user nova-compute[75340]: No targets found.
Nov 30 09:32:37 user nova-compute[75340]: STATIC:
Nov 30 09:32:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f
Nov 30 09:32:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:32:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:32:37 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:32:37 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:32:37 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:32:37 user nova-compute[75340]: FIRMWARE:
Nov 30 09:32:37 user nova-compute[75340]: No targets found.
Nov 30 09:32:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:32:37 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:32:37 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b94e382-c9ef-4582-9289-2788a9e7a535]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1490ac35-f756-4d48-8e5d-43cc6dc1b425]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:32:37 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:32:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f (non-flash)
Nov 30 09:32:37 user nova-compute[75340]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:32:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[52532053-e629-48e8-8b31-9103a58ea3ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9341f4-d823-4d77-909e-e353556fcb64]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e6fc1-6fe2-49c4-b12b-cfc3d5cfaea2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e800e2ec-f6ae-4d14-881f-67bc5bb431b0]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[97804c9b-a1d1-44a4-9287-d7f19a437d23]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87c447-810d-425a-9f24-f33048a57dcd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260]
Nov 30 09:32:37 user nova-compute[75340]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f, portal: 172.16.0.220,3260] successful.
Nov 30 09:32:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d2f72-8aa2-47d8-b17f-0a570cca371f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0947ee85-26a0-4127-a8ef-a085bb693965]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] <== disconnect_volume: return (334ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:32:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:32:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Deleting instance files /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193_del
Nov 30 09:32:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Deletion of /opt/stack/data/nova/instances/3f707e1f-21fa-4122-94ee-7eb3f28df193_del complete
Nov 30 09:32:38 user nova-compute[75340]: INFO nova.compute.manager [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 30 09:32:38 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-e1e2a214-f11f-4176-8895-6a2bbb8d1dfb req-cc011d69-0650-40f6-acd9-04666c67f2ee service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-deleted-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:38 user nova-compute[75340]: INFO nova.compute.manager [req-e1e2a214-f11f-4176-8895-6a2bbb8d1dfb req-cc011d69-0650-40f6-acd9-04666c67f2ee service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Neutron deleted interface 566ae665-b699-43cb-8d13-55fd4866990a; detaching it from the instance and deleting it from the info cache
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.network.neutron [req-e1e2a214-f11f-4176-8895-6a2bbb8d1dfb req-cc011d69-0650-40f6-acd9-04666c67f2ee service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:38 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Took 0.52 seconds to deallocate network for instance.
Nov 30 09:32:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-e1e2a214-f11f-4176-8895-6a2bbb8d1dfb req-cc011d69-0650-40f6-acd9-04666c67f2ee service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Detach interface failed, port_id=566ae665-b699-43cb-8d13-55fd4866990a, reason: Instance 3f707e1f-21fa-4122-94ee-7eb3f28df193 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] Acquiring lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG nova.compute.manager [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] No waiting events found dispatching network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:32:39 user nova-compute[75340]: WARNING nova.compute.manager [req-d828450e-5227-4b23-93de-92a70a84a37f req-9f42649a-41a5-439d-9cbd-d05d241e27ef service nova] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Received unexpected event network-vif-plugged-566ae665-b699-43cb-8d13-55fd4866990a for instance with vm_state active and task_state deleting.
Nov 30 09:32:39 user nova-compute[75340]: INFO nova.compute.manager [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 3f707e1f-21fa-4122-94ee-7eb3f28df193] Took 1.00 seconds to detach 1 volumes for instance.
Nov 30 09:32:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:32:39 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:32:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:40 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Deleted allocations for instance 3f707e1f-21fa-4122-94ee-7eb3f28df193
Nov 30 09:32:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-02258943-3414-45f5-b184-696d80aed3b3 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "3f707e1f-21fa-4122-94ee-7eb3f28df193" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.406s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:32:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:32:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:32:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [{"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-59ea1092-6591-4aae-aabd-325ed17ac394" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:32:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing instance network info cache due to event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:32:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:49 user nova-compute[75340]: INFO nova.compute.manager [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Detaching volume e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:32:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:49 user nova-compute[75340]: INFO nova.virt.block_device [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Attempting to driver detach volume e360513f-76a7-473f-9de9-76766af24a8d from mountpoint /dev/vdb
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Attempting to detach device vdb from instance 28ec2815-8cb8-476b-a830-aab627c77a14 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:32:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:32:49 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:32:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:32:49 user nova-compute[75340]:   <serial>e360513f-76a7-473f-9de9-76766af24a8d</serial>
Nov 30 09:32:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:32:49 user nova-compute[75340]: </disk>
Nov 30 09:32:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:32:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully detached device vdb from instance 28ec2815-8cb8-476b-a830-aab627c77a14 from the persistent domain config.
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28ec2815-8cb8-476b-a830-aab627c77a14 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:32:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:32:49 user nova-compute[75340]:   <source dev="/dev/sdf"/>
Nov 30 09:32:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:32:49 user nova-compute[75340]:   <serial>e360513f-76a7-473f-9de9-76766af24a8d</serial>
Nov 30 09:32:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:32:49 user nova-compute[75340]: </disk>
Nov 30 09:32:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updated VIF entry in instance network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a2b3b63f-73fb-4105-bed8-103773e54b81 req-ab071160-4433-4a2b-92be-4f4278732990 service nova] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:32:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:32:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing instance network info cache due to event network-changed-99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:32:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] Acquiring lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:32:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] Acquired lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:32:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Refreshing network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:32:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updated VIF entry in instance network info cache for port 99eb1c19-9dbf-45a6-9164-918c020b2c8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:32:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [{"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:32:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f0a39a4-5451-4fb1-a936-fa4a41d1a6c3 req-974a2b8f-f75d-4245-a2dd-6632d0075196 service nova] Releasing lock "refresh_cache-28ec2815-8cb8-476b-a830-aab627c77a14" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:32:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:32:56 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:32:56 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=25.10460662841797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 342c9729-6990-4f95-8d1e-6c3ba45a881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 21360976-bd14-407a-82f3-7543a1f052b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 28ec2815-8cb8-476b-a830-aab627c77a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fd49b4fa-b431-4846-b8d7-aa6913be4198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c3814f52-db11-4fb4-b272-c5cf794511f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:32:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:32:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:32:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:32:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:32:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:32:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:32:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28ec2815-8cb8-476b-a830-aab627c77a14 is timed out.
Nov 30 09:33:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully detached device vdb from instance 28ec2815-8cb8-476b-a830-aab627c77a14 from the live domain config.
Nov 30 09:33:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rubtNJCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:33:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68520c-dceb-4fca-924a-bc573d03c59a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:33:09 user nova-compute[75340]: No targets found.
Nov 30 09:33:09 user nova-compute[75340]: iSNS:
Nov 30 09:33:09 user nova-compute[75340]: No targets found.
Nov 30 09:33:09 user nova-compute[75340]: STATIC:
Nov 30 09:33:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d
Nov 30 09:33:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:33:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:33:09 user nova-compute[75340]: FIRMWARE:
Nov 30 09:33:09 user nova-compute[75340]: No targets found.
Nov 30 09:33:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:33:09 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:33:09 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86fcdf3-aded-41ce-8f2a-e583af27d625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[40995508-69e9-4fa4-a848-b9518433a3a1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:33:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d (non-flash)
Nov 30 09:33:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff3053c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d'): ({'sdf'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Removing single pathed devices sdf {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54c9fa-925c-47ee-bef6-701a3c35c532]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc8676-dfed-4afd-ba77-c9400ba70abc]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Flushing IO for device /dev/sdf {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f51a0-65f9-4550-a991-dc94e84c2e72]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e10c23-f167-419c-9903-54a9680e3c41]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] SCSI volumes sdf have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b564ffe-5abc-4023-bd3c-5b733a1e9732]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c6ad5-bdd1-4e8f-9f98-b492d030ba94]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260]
Nov 30 09:33:09 user nova-compute[75340]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d, portal: 172.16.0.220,3260] successful.
Nov 30 09:33:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e360513f-76a7-473f-9de9-76766af24a8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3285e8d9-5161-46e4-96f2-9ca9ec210532]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] <== disconnect_volume: return (297ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:33:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:33:10 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'flavor' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b94a1e8f-3f72-423a-b89a-47b940e6fb97 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.787s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:26 user nova-compute[75340]: INFO nova.compute.manager [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Terminating instance
Nov 30 09:33:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-unplugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] No waiting events found dispatching network-vif-unplugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-dc8cc6fc-4a3c-4763-a368-ff4ceda0b7fa req-72cff1f8-bd6a-4319-a073-182e81179680 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-unplugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Instance destroyed successfully.
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lazy-loading 'resources' on Instance uuid 21360976-bd14-407a-82f3-7543a1f052b3 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-43643442',display_name='tempest-ServerActionsTestOtherA-server-43643442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-43643442',id=6,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB0+vSF725itot0p7B7wk4s6QrhPDBT+lQQdS+NqjfJKcXdKKiJ7JukG8laYWzs03lLgXfKVyfSYHBbZyuKhlv7y0u2ZNyYID2EKkSoNaCsZ6HpSM9XLJuTRNnlP+qfoA==',key_name='tempest-keypair-1536375589',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2a93601bf545c7b13b34afc2c0da24',ramdisk_id='',reservation_id='r-q72hkzyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1563000763',owner_user_name='tempest-ServerActionsTestOtherA-1563000763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fabd845c2a4368bab99d4ca469452a',uuid=21360976-bd14-407a-82f3-7543a1f052b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converting VIF {"id": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "address": "fa:16:3e:b8:d1:dc", "network": {"id": "2cb8f4e4-2296-4679-9353-9a5d8222a695", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876055800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a93601bf545c7b13b34afc2c0da24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa643fa77-08", "ovs_interfaceid": "a643fa77-0868-48a4-8fa9-0e40ea283e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG os_vif [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa643fa77-08, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ac588c3-2e29-4457-bb07-fba5a68aa944) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: INFO os_vif [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d1:dc,bridge_name='br-int',has_traffic_filtering=True,id=a643fa77-0868-48a4-8fa9-0e40ea283e70,network=Network(2cb8f4e4-2296-4679-9353-9a5d8222a695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa643fa77-08')
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Deleting instance files /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3_del
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Deletion of /opt/stack/data/nova/instances/21360976-bd14-407a-82f3-7543a1f052b3_del complete
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.compute.manager [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.compute.manager [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Terminating instance
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:27 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:27 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Took 0.83 seconds to deallocate network for instance.
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-26737ef8-875e-48e0-89b6-0e5ca2f41748 req-7e8dad8d-db66-48a5-ad86-baf810840929 service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-deleted-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Instance destroyed successfully.
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lazy-loading 'resources' on Instance uuid 342c9729-6990-4f95-8d1e-6c3ba45a881c {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369991683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369991683',id=3,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:14:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e9daa1b03684fb6b29fa66f0f355e47',ramdisk_id='',reservation_id='r-9mul84uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:15:45Z,user_data=None,user_id='14f79ef5cc314a3bb971a811a317a5ea',uuid=342c9729-6990-4f95-8d1e-6c3ba45a881c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converting VIF {"id": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "address": "fa:16:3e:9a:67:3d", "network": {"id": "ba4dcd47-7f92-47bf-8502-c41e12df55df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-761338159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e9daa1b03684fb6b29fa66f0f355e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17daaea6-cb", "ovs_interfaceid": "17daaea6-cbc9-4d12-851e-d03dd3a2113e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG os_vif [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17daaea6-cb, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4e7080f-043a-4839-b333-87ccef350813) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:28 user nova-compute[75340]: INFO os_vif [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:67:3d,bridge_name='br-int',has_traffic_filtering=True,id=17daaea6-cbc9-4d12-851e-d03dd3a2113e,network=Network(ba4dcd47-7f92-47bf-8502-c41e12df55df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17daaea6-cb')
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Deleting instance files /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c_del
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Deletion of /opt/stack/data/nova/instances/342c9729-6990-4f95-8d1e-6c3ba45a881c_del complete
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Deleted allocations for instance 21360976-bd14-407a-82f3-7543a1f052b3
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.compute.manager [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b36faed-b2a8-46f3-aaa7-70a05cda202e tempest-ServerActionsTestOtherA-1563000763 tempest-ServerActionsTestOtherA-1563000763-project-member] Lock "21360976-bd14-407a-82f3-7543a1f052b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.381s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] Acquiring lock "21360976-bd14-407a-82f3-7543a1f052b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] Lock "21360976-bd14-407a-82f3-7543a1f052b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.compute.manager [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] No waiting events found dispatching network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:28 user nova-compute[75340]: WARNING nova.compute.manager [req-66f25f95-4369-4337-9576-15eb44b5021c req-41561e20-3980-42cd-8341-e5f26b505f9e service nova] [instance: 21360976-bd14-407a-82f3-7543a1f052b3] Received unexpected event network-vif-plugged-a643fa77-0868-48a4-8fa9-0e40ea283e70 for instance with vm_state deleted and task_state None.
Nov 30 09:33:28 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:28 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Took 0.43 seconds to deallocate network for instance.
Nov 30 09:33:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:29 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:29 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:29 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Deleted allocations for instance 342c9729-6990-4f95-8d1e-6c3ba45a881c
Nov 30 09:33:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-af5c9555-9dc8-4a19-8a61-08eb27593c27 tempest-ServerBootFromVolumeStableRescueTest-1860517129 tempest-ServerBootFromVolumeStableRescueTest-1860517129-project-member] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-vif-unplugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] No waiting events found dispatching network-vif-unplugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:30 user nova-compute[75340]: WARNING nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received unexpected event network-vif-unplugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e for instance with vm_state deleted and task_state None.
Nov 30 09:33:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Acquiring lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] Lock "342c9729-6990-4f95-8d1e-6c3ba45a881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] No waiting events found dispatching network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:30 user nova-compute[75340]: WARNING nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received unexpected event network-vif-plugged-17daaea6-cbc9-4d12-851e-d03dd3a2113e for instance with vm_state deleted and task_state None.
Nov 30 09:33:30 user nova-compute[75340]: DEBUG nova.compute.manager [req-9f3d0cd1-4232-43e6-8003-bbbd5d5495cf req-e338260f-22cb-409c-a9c9-91c135504ba6 service nova] [instance: 342c9729-6990-4f95-8d1e-6c3ba45a881c] Received event network-vif-deleted-17daaea6-cbc9-4d12-851e-d03dd3a2113e {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-changed-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Refreshing instance network info cache due to event network-changed-96ae019f-fe4b-4739-8bcd-697e10e57ff0. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] Acquiring lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] Acquired lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Refreshing network info cache for port 96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updated VIF entry in instance network info cache for port 96ae019f-fe4b-4739-8bcd-697e10e57ff0. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updating instance_info_cache with network_info: [{"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1182877f-2369-4998-b04d-679a32470a66 req-6b932f28-a1d8-492b-9e79-d384305d0145 service nova] Releasing lock "refresh_cache-fd49b4fa-b431-4846-b8d7-aa6913be4198" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:33 user nova-compute[75340]: INFO nova.compute.manager [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Unshelving
Nov 30 09:33:33 user nova-compute[75340]: INFO nova.virt.block_device [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Booting with volume bb2be1b3-b3c4-43be-acf2-44261f483f35 at /dev/vda
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.utils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461d673-3efb-46ca-9a13-bcc7d37445f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d78171-3d41-488f-98ef-3c423cc97d5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[755035e6-a99d-47b9-b188-28e3bd2cbab1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd26239-0a6a-4836-944b-b83200a96d13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:33:33 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:33:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[752dcd74-9c20-4054-8179-e682c6d9dcdb]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG os_brick.utils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:33:33 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating existing volume attachment record: c09a05ef-0f91-4645-bebb-a078d416edad {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:33:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lazy-loading 'flavor' on Instance uuid fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:35 user nova-compute[75340]: INFO nova.compute.manager [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Attaching volume 484c7971-2557-4246-bda6-9a970fe76cd5 to /dev/vdb
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.utils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2ec8e-3502-4ada-b537-5ab907424133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[16deb2b5-ccbb-4ea1-8268-26523de80cc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e99729-6ed5-44b0-ac91-b9d85abe9081]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c402ae27-ed1e-4778-8040-fab18a8b681e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:33:35 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:33:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a228529-2010-493f-b4ae-29790146012c]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG os_brick.utils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:33:35 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updating existing volume attachment record: 37c9a65c-5a42-4d90-8d08-bc73e6eec047 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:33:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:39 user nova-compute[75340]: INFO nova.compute.manager [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Terminating instance
Nov 30 09:33:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Instance destroyed successfully.
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 28ec2815-8cb8-476b-a830-aab627c77a14 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578052888',display_name='tempest-ServerRescueNegativeTestJSON-server-578052888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578052888',id=34,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsCBd2ReazykrovKRl1b2E+iXX1BKrpy8UtkoWEeWMTUT+3OykqKpzQehFh0Lv88PF+EODJwGHHO6BFvri7Xw2bmHCLJUAVgmXGerC2B7dAcpxeo2RcivWUDQTMJmnsjQ==',key_name='tempest-keypair-127598941',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:29:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-lkhvjnx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=28ec2815-8cb8-476b-a830-aab627c77a14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "address": "fa:16:3e:7f:a8:88", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99eb1c19-9d", "ovs_interfaceid": "99eb1c19-9dbf-45a6-9164-918c020b2c8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG os_vif [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99eb1c19-9d, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-7fd365a5-b11b-44fd-aff5-1146002c539b req-c06ddd25-8e7f-42c7-ae1b-ece954bdb492 service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-unplugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59a18d2c-4da3-4279-bf77-6776b64e917c) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:40 user nova-compute[75340]: INFO os_vif [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a8:88,bridge_name='br-int',has_traffic_filtering=True,id=99eb1c19-9dbf-45a6-9164-918c020b2c8c,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99eb1c19-9d')
Nov 30 09:33:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Deleting instance files /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14_del
Nov 30 09:33:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Deletion of /opt/stack/data/nova/instances/28ec2815-8cb8-476b-a830-aab627c77a14_del complete
Nov 30 09:33:40 user nova-compute[75340]: INFO nova.compute.manager [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 30 09:33:40 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:33:40 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:41 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Took 0.96 seconds to deallocate network for instance.
Nov 30 09:33:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing instance network info cache due to event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:42 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Deleted allocations for instance 28ec2815-8cb8-476b-a830-aab627c77a14
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-37f0a15e-66f9-41c9-9f08-56d5fd76a773 tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "28ec2815-8cb8-476b-a830-aab627c77a14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.614s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.network.neutron [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updated VIF entry in instance network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.network.neutron [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-723cba2e-c70e-4588-980d-e297f230dd7b req-fd07afab-556a-4c26-a77d-4195e2fa4df7 service nova] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] Acquiring lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] Lock "28ec2815-8cb8-476b-a830-aab627c77a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] No waiting events found dispatching network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:42 user nova-compute[75340]: WARNING nova.compute.manager [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received unexpected event network-vif-plugged-99eb1c19-9dbf-45a6-9164-918c020b2c8c for instance with vm_state deleted and task_state None.
Nov 30 09:33:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-78efaa6f-55e4-4c13-9990-15d9455add32 req-3970d7f7-5dbd-4173-ae4b-0b6fb70bdede service nova] [instance: 28ec2815-8cb8-476b-a830-aab627c77a14] Received event network-vif-deleted-99eb1c19-9dbf-45a6-9164-918c020b2c8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG nova.objects.instance [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'pci_requests' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG nova.objects.instance [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'numa_topology' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:43 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:33:43 user nova-compute[75340]: INFO nova.compute.claims [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Claim successful on node user
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:44 user nova-compute[75340]: INFO nova.network.neutron [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing instance network info cache due to event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:33:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.network.neutron [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:33:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Creating image(s)
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start _get_guest_xml network_info=[{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'c09a05ef-0f91-4645-bebb-a078d416edad', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06803cbd-89e9-40c6-90fe-cdb61836e4d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb2be1b3-b3c4-43be-acf2-44261f483f35', 'serial': 'bb2be1b3-b3c4-43be-acf2-44261f483f35'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:33:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:33:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.objects.instance [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MLDkhctb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:33:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.017s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:33:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:33:45 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.objects.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Object Instance<06803cbd-89e9-40c6-90fe-cdb61836e4d7> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:33:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b2b7a7-dfc2-4ae2-9e9f-bf90df9a6396]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:33:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae29dc-e8b4-4be6-9a16-77abbdc74bf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5] added
Nov 30 09:33:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0787ef12-c359-4995-b03c-0f32b88b1416]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d32ab2-d7d0-4563-89ea-af5fc66d8ea7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MLDkhctb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MLDkhctb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31dbfba-0ca4-4bb0-8d8c-9a37268e753d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MLDkhctb'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d76e54-bb6e-43ce-86e1-e77a6c24a70e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[75706039-5b5d-4739-9e85-5ea19b9a65b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:33:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:33:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:33:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:33:45 user nova-compute[75340]: 
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e799448-625b-4bc9-8c79-c294f6bc9e0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260]
Nov 30 09:33:45 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260] successful.
Nov 30 09:33:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fb307-409d-4e8c-85e8-efd6f948cc0f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:45 user nova-compute[75340]: INFO nova.compute.manager [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Shelving
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e6227-6a6b-4d47-9e58-2d5771848aa1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d1fea9-0658-4bec-a0ca-c20b33061199]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updated VIF entry in instance network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d53247a7-518b-49fc-8879-0a097476f7c7 req-fa9491ee-f501-46b4-8e08-e09a4f94aa6b service nova] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:46 user nova-compute[75340]: WARNING nova.compute.manager [req-2607fd3d-4f09-49d4-a96d-4aa7704ae966 req-0396bdfb-35ba-425a-bfac-f4e29aa42333 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state active and task_state shelving.
Nov 30 09:33:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance destroyed successfully.
Nov 30 09:33:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Beginning cold snapshot process
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk /opt/stack/data/nova/instances/snapshots/tmpt1zoqjkf/14d4f391936b46f7a998af79148e7bb1 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MLDkhctb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23633316238353436', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633316238353436', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:33:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:33:46 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002a20b-05ec-4562-a15b-921e6ebaebb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:33:46 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lazy-loading 'flavor' on Instance uuid fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[88306727-9a96-4849-b8f6-2b75212b22cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35] added
Nov 30 09:33:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:33:46 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:33:46 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:33:46 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:33:46 user nova-compute[75340]:   <serial>484c7971-2557-4246-bda6-9a970fe76cd5</serial>
Nov 30 09:33:46 user nova-compute[75340]: </disk>
Nov 30 09:33:46 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b768df7-c0c1-43cd-8460-079fe9f11b18]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f43ed-a0cc-4c46-8723-f74446a3a696]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqLgQrTs {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqLgQrTs" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd089ed3-7d0e-4cc2-b843-b7b3a208fa5d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqLgQrTs'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2bef7-bba3-4393-9d84-449f72cbc7b9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[89888832-4a3e-4cbe-bf0e-5c8b3556ce13]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed23d0d-20a7-4c66-9d0c-ea7d1d139363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]
Nov 30 09:33:47 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.
Nov 30 09:33:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ce15a-a934-40d6-aab1-0d808e2bc3c0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk /opt/stack/data/nova/instances/snapshots/tmpt1zoqjkf/14d4f391936b46f7a998af79148e7bb1" returned: 0 in 0.476s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Snapshot extracted, beginning image upload
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4980a47-3a77-48b9-9f06-e12fa0d790c2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:33:47 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b123a739-7755-40f6-87b9-8c3daf9ed190]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] No VIF found with MAC fa:16:3e:a5:05:a8, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [{"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-029a6160-a6bb-4a6a-ae54-22819e4c4bd9" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c2ce8410-cc06-4bda-86ab-0399dc91ab08 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.834s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:48 user nova-compute[75340]: WARNING nova.compute.manager [req-cda72ffb-c91e-4830-9508-33ce3073a0aa req-28bf88d5-9d69-4699-8e00-cb9d53f2aa92 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 09:33:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== connect_volume: return (2670ms) {'type': 'block', 'scsi_wwn': '26632346138663333', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632346138663333', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1377343270',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:33:34Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.objects.instance [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'pci_devices' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.objects.base [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Object Instance<06803cbd-89e9-40c6-90fe-cdb61836e4d7> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:33:48 user nova-compute[75340]:   <uuid>06803cbd-89e9-40c6-90fe-cdb61836e4d7</uuid>
Nov 30 09:33:48 user nova-compute[75340]:   <name>instance-00000026</name>
Nov 30 09:33:48 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:33:48 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:33:48 user nova-compute[75340]:   <metadata>
Nov 30 09:33:48 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:33:48 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:33:48 user nova-compute[75340]:       <nova:name>tempest-TestShelveInstance-server-256984797</nova:name>
Nov 30 09:33:48 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:33:45</nova:creationTime>
Nov 30 09:33:48 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:33:48 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:33:48 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:33:48 user nova-compute[75340]:       <nova:owner>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:user uuid="167a6f85251d4513b9953681ac119e66">tempest-TestShelveInstance-187239747-project-member</nova:user>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:project uuid="5f1a9ce07006430d92f23d4161b70f01">tempest-TestShelveInstance-187239747</nova:project>
Nov 30 09:33:48 user nova-compute[75340]:       </nova:owner>
Nov 30 09:33:48 user nova-compute[75340]:       <nova:ports>
Nov 30 09:33:48 user nova-compute[75340]:         <nova:port uuid="e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8">
Nov 30 09:33:48 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:33:48 user nova-compute[75340]:         </nova:port>
Nov 30 09:33:48 user nova-compute[75340]:       </nova:ports>
Nov 30 09:33:48 user nova-compute[75340]:     </nova:instance>
Nov 30 09:33:48 user nova-compute[75340]:   </metadata>
Nov 30 09:33:48 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:33:48 user nova-compute[75340]:     <system>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="serial">06803cbd-89e9-40c6-90fe-cdb61836e4d7</entry>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="uuid">06803cbd-89e9-40c6-90fe-cdb61836e4d7</entry>
Nov 30 09:33:48 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:33:48 user nova-compute[75340]:     </system>
Nov 30 09:33:48 user nova-compute[75340]:   </sysinfo>
Nov 30 09:33:48 user nova-compute[75340]:   <os>
Nov 30 09:33:48 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:33:48 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:33:48 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:33:48 user nova-compute[75340]:   </os>
Nov 30 09:33:48 user nova-compute[75340]:   <features>
Nov 30 09:33:48 user nova-compute[75340]:     <acpi/>
Nov 30 09:33:48 user nova-compute[75340]:     <apic/>
Nov 30 09:33:48 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:33:48 user nova-compute[75340]:   </features>
Nov 30 09:33:48 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:33:48 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:33:48 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:33:48 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:33:48 user nova-compute[75340]:   </clock>
Nov 30 09:33:48 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:33:48 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:33:48 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:33:48 user nova-compute[75340]:   </cpu>
Nov 30 09:33:48 user nova-compute[75340]:   <devices>
Nov 30 09:33:48 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:33:48 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:33:48 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:33:48 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:33:48 user nova-compute[75340]:       <serial>bb2be1b3-b3c4-43be-acf2-44261f483f35</serial>
Nov 30 09:33:48 user nova-compute[75340]:     </disk>
Nov 30 09:33:48 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:33:48 user nova-compute[75340]:       <mac address="fa:16:3e:fb:98:b2"/>
Nov 30 09:33:48 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:33:48 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:33:48 user nova-compute[75340]:       <target dev="tape87c43f9-1b"/>
Nov 30 09:33:48 user nova-compute[75340]:     </interface>
Nov 30 09:33:48 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:33:48 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7/console.log" append="off"/>
Nov 30 09:33:48 user nova-compute[75340]:     </serial>
Nov 30 09:33:48 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:33:48 user nova-compute[75340]:     <video>
Nov 30 09:33:48 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:33:48 user nova-compute[75340]:     </video>
Nov 30 09:33:48 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:33:48 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:33:48 user nova-compute[75340]:     </rng>
Nov 30 09:33:48 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:33:48 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:33:48 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:33:48 user nova-compute[75340]:     </memballoon>
Nov 30 09:33:48 user nova-compute[75340]:   </devices>
Nov 30 09:33:48 user nova-compute[75340]: </domain>
Nov 30 09:33:48 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1377343270',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:33:34Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG os_vif [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d6788f4-4118-5f45-9640-6869bf15b801', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87c43f9-1b, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape87c43f9-1b, col_values=(('qos', UUID('b0b797bd-ab0d-418e-b88d-144e614ef77e')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape87c43f9-1b, col_values=(('external_ids', {'iface-id': 'e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:98:b2', 'vm-uuid': '06803cbd-89e9-40c6-90fe-cdb61836e4d7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:48 user nova-compute[75340]: INFO os_vif [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b')
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:33:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] No VIF found with MAC fa:16:3e:fb:98:b2, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:33:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:49 user nova-compute[75340]: INFO nova.compute.manager [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Detaching volume 484c7971-2557-4246-bda6-9a970fe76cd5
Nov 30 09:33:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:49 user nova-compute[75340]: INFO nova.virt.block_device [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Attempting to driver detach volume 484c7971-2557-4246-bda6-9a970fe76cd5 from mountpoint /dev/vdb
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Attempting to detach device vdb from instance fd49b4fa-b431-4846-b8d7-aa6913be4198 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:33:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:33:49 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:33:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:33:49 user nova-compute[75340]:   <serial>484c7971-2557-4246-bda6-9a970fe76cd5</serial>
Nov 30 09:33:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:33:49 user nova-compute[75340]: </disk>
Nov 30 09:33:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:33:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Successfully detached device vdb from instance fd49b4fa-b431-4846-b8d7-aa6913be4198 from the persistent domain config.
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd49b4fa-b431-4846-b8d7-aa6913be4198 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:33:49 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:33:49 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:33:49 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:33:49 user nova-compute[75340]:   <serial>484c7971-2557-4246-bda6-9a970fe76cd5</serial>
Nov 30 09:33:49 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:33:49 user nova-compute[75340]: </disk>
Nov 30 09:33:49 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:33:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Snapshot image upload complete
Nov 30 09:33:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:33:50 user nova-compute[75340]: INFO nova.compute.manager [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Shelve offloading
Nov 30 09:33:50 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance destroyed successfully.
Nov 30 09:33:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:50 user nova-compute[75340]: WARNING nova.compute.manager [req-0a7f7212-d576-44ab-94f9-2886bd7cba63 req-9065e887-455f-4bb4-ab34-063e2a691e04 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:33:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance destroyed successfully.
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'resources' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPAuePxfVK9KzfjPCWK5pwa924BGsv9d0OXvzlR5J/iQjHOCHafLlE0ynMfVMhm0AamVDyJ7pS73pxeQ0DQok4lzTIo8Chv/rcVlWP5i7BHAbB7/+pcGT1QgmgAl2kvjQ==',key_name='tempest-keypair-264695344',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:33:49.927408',shelved_host='user',shelved_image_id='5f3ba9ce-6ade-414b-9a2b-876e9f09af77'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG os_vif [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9cdba3-35, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a31384c0-23c2-46c8-9934-716249067369) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:51 user nova-compute[75340]: INFO os_vif [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35')
Nov 30 09:33:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Deleting instance files /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2_del
Nov 30 09:33:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Deletion of /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2_del complete
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing instance network info cache due to event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:33:51 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Deleted allocations for instance c3814f52-db11-4fb4-b272-c5cf794511f2
Nov 30 09:33:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'numa_topology' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:33:51 user nova-compute[75340]: DEBUG nova.objects.base [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<c3814f52-db11-4fb4-b272-c5cf794511f2> lazy-loaded attributes: resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updated VIF entry in instance network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-429dba8a-52c4-459d-be8f-86405ede608a req-58231a6f-5f11-47c1-951e-681df89f52e9 service nova] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f42c2bf4-5dd5-4eec-9b26-7b5384f69a35 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.374s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:33:52 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance spawned successfully.
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:33:52 user nova-compute[75340]: WARNING nova.compute.manager [req-1f3a0cd8-d98f-4547-95ad-234e715856b0 req-fe63c9dc-0bca-4a01-bb79-51e0336096e6 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-22bbe953-30b0-49ee-bf35-f9a30b11ac2d tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.911s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:33:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:33:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:33:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:33:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=25.252567291259766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fd49b4fa-b431-4846-b8d7-aa6913be4198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:33:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:33:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-changed-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Refreshing instance network info cache due to event network-changed-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] Acquiring lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] Acquired lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Refreshing network info cache for port 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updated VIF entry in instance network info cache for port 9fb0fd9a-ffb2-412e-a524-8fe23cbb0399. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating instance_info_cache with network_info: [{"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:33:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a83243bd-c903-4024-b60b-1cbfeb65ecb2 req-53e41618-ff8c-4761-a273-a91af25700ee service nova] Releasing lock "refresh_cache-8d552527-2746-4f2d-9f50-4dbbf34558e7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:33:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:33:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:03 user nova-compute[75340]: INFO nova.compute.manager [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attaching volume 64dbe6e3-4670-4625-8cd6-5a7a171e9a89 to /dev/vdb
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.utils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc1716-9ee7-4cdd-b421-b26a8a0323ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72657a1-9288-41fc-aa58-3d74e205a46f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cde257-b481-4650-ac35-4775745a939e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cad7a1-b8de-4642-8d89-0497182501dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:34:03 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:34:03 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9ae216-0b9d-427b-ba8a-df7ed6c3db46]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG os_brick.utils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:03 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating existing volume attachment record: 75115b2b-7a59-4cb6-990d-7636e97feb64 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:34:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd49b4fa-b431-4846-b8d7-aa6913be4198 is timed out.
Nov 30 09:34:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Successfully detached device vdb from instance fd49b4fa-b431-4846-b8d7-aa6913be4198 from the live domain config.
Nov 30 09:34:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MLDkhctb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[306865c8-41a5-4c4e-b437-0b9afb5c1a9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:34:09 user nova-compute[75340]: No targets found.
Nov 30 09:34:09 user nova-compute[75340]: iSNS:
Nov 30 09:34:09 user nova-compute[75340]: No targets found.
Nov 30 09:34:09 user nova-compute[75340]: STATIC:
Nov 30 09:34:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:34:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:34:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:34:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5
Nov 30 09:34:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:34:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:34:09 user nova-compute[75340]: FIRMWARE:
Nov 30 09:34:09 user nova-compute[75340]: No targets found.
Nov 30 09:34:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:34:09 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:34:09 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc545cf-b997-41d4-922e-e1019b4f9985]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ee94c-9e97-40a1-8420-30f533bb721d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:34:09 user nova-compute[75340]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 (non-flash)
Nov 30 09:34:09 user nova-compute[75340]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50125990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c8954-e364-4325-b921-99e7e05964d4]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef31ec3-0a4d-4d84-a362-a093c38d02cb]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf855262-0720-4037-a4e8-519fef47d990]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764ef59-32ab-4fd8-bbca-fd131be7a0f8]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc139e87-7980-490d-88a3-3f7d36214c0e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28d501-10ad-4a53-9058-bb33a47c50ca]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260]
Nov 30 09:34:10 user nova-compute[75340]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5, portal: 172.16.0.220,3260] successful.
Nov 30 09:34:10 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484c7971-2557-4246-bda6-9a970fe76cd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27d63f-2fc6-4f74-8a85-955839cd0e04]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] <== disconnect_volume: return (288ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:34:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lazy-loading 'flavor' on Instance uuid fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-19d5237f-f821-4469-8b1d-876eb3eaa5f2 tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.675s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMnoEfdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:14 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:14 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee671b-c3bd-461a-bc93-24ecd4f6b281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:34:14 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac505a5-14c9-4c86-be2e-4fafc9d55670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89] added
Nov 30 09:34:14 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c7310c-8690-4f24-b9ae-bc934c2bd1e0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5c57a3-8fc3-4c9d-8429-425addcfe319]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMnoEfdB {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMnoEfdB" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade2bc8-e586-425e-bc49-599504df7418]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMnoEfdB'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6713aa9-773e-497d-b77c-88f4597c879a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13a0c9-966a-4d87-b6ee-98fea4764d8f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[798542c7-b545-4ebb-95c7-5738f3fa5ed6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260]
Nov 30 09:34:15 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260] successful.
Nov 30 09:34:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb7f84c-94c5-4cda-84e9-8176c15ad481]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f8819-506e-42a9-9204-7f5298f66ff4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e7ccfe-befe-4e3c-ae50-34fb87fb4e73]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMnoEfdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23465636130313036', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465636130313036', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:34:16 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:16 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:34:16 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:34:16 user nova-compute[75340]:   <serial>64dbe6e3-4670-4625-8cd6-5a7a171e9a89</serial>
Nov 30 09:34:16 user nova-compute[75340]: </disk>
Nov 30 09:34:16 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No VIF found with MAC fa:16:3e:05:15:5b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:34:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b168aa67-7cde-48a7-b552-b39b34c6e43f tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.430s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:19 user nova-compute[75340]: DEBUG nova.objects.instance [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:20 user nova-compute[75340]: INFO nova.compute.manager [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attaching volume 279f806b-a576-4ea5-a98c-05034ae7439d to /dev/vdc
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.utils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a0c63-deb8-4acb-8053-a4d4ab5f4ffd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5339e5-0207-4857-a1b3-8c95850d6802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931d622-7131-4cb7-ba1e-4748da666c68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[920fbac7-a4cb-4e4a-9479-0c3bdda3bf52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:34:20 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:34:20 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de8ee9-4eaa-49f9-904b-111fb7810186]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG os_brick.utils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating existing volume attachment record: 2babe144-b4e7-43aa-9ae2-f1bd31a7a42c {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZFiDze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:29 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:29 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:29 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaede95-a959-4fd6-95d4-6f5ed4bf7eee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:34:29 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f3c35-26f1-4398-97f9-e3b4ad609cfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d] added
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e46762-5945-4465-8610-6a821b6854f2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638e302-2182-49cb-8042-901ef9b2c894]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmZFiDze {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmZFiDze" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[903281ff-8915-43ce-b1e0-e3450ab19b6e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmZFiDze'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da1068-9f10-47a1-bf17-b0178a018b50]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e0506-b805-4a3e-99b3-4fd9824aea3e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d28e3ff-8eef-47a9-9272-bb556f474ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260]
Nov 30 09:34:29 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260] successful.
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a6b97-66ab-4a55-b4d0-feb91fc99822]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cef3b7-ab92-4430-998a-54a320c6ce2c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:29 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:34:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb20de3e-7552-4df2-8fe3-39a803f8a625]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZFiDze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23663326262323931', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663326262323931', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG nova.objects.instance [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:34:30 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:30 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:34:30 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:34:30 user nova-compute[75340]:   <serial>279f806b-a576-4ea5-a98c-05034ae7439d</serial>
Nov 30 09:34:30 user nova-compute[75340]: </disk>
Nov 30 09:34:30 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] No VIF found with MAC fa:16:3e:05:15:5b, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86c56500-cecf-48dc-9b48-000097d31061 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.266s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:32 user nova-compute[75340]: INFO nova.compute.manager [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Detaching volume 64dbe6e3-4670-4625-8cd6-5a7a171e9a89
Nov 30 09:34:32 user nova-compute[75340]: INFO nova.virt.block_device [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attempting to driver detach volume 64dbe6e3-4670-4625-8cd6-5a7a171e9a89 from mountpoint /dev/vdb
Nov 30 09:34:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Attempting to detach device vdb from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:34:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:34:32 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:32 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:34:32 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:34:32 user nova-compute[75340]:   <serial>64dbe6e3-4670-4625-8cd6-5a7a171e9a89</serial>
Nov 30 09:34:32 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:34:32 user nova-compute[75340]: </disk>
Nov 30 09:34:32 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:34:32 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdb from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the persistent domain config.
Nov 30 09:34:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:34:32 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:34:32 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:32 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:34:32 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:34:32 user nova-compute[75340]:   <serial>64dbe6e3-4670-4625-8cd6-5a7a171e9a89</serial>
Nov 30 09:34:32 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:34:32 user nova-compute[75340]: </disk>
Nov 30 09:34:32 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:34:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:34:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:41 user nova-compute[75340]: INFO nova.compute.manager [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Terminating instance
Nov 30 09:34:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f2e9fb95-5354-4751-9f85-232757a19358 req-b8834a9c-ce81-461c-ad47-c9ded5279f28 service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-unplugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:34:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Instance destroyed successfully.
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.objects.instance [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 029a6160-a6bb-4a6a-ae54-22819e4c4bd9 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-64774986',display_name='tempest-ServerRescueNegativeTestJSON-server-64774986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-64774986',id=20,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-yh0scy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:20:25Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=029a6160-a6bb-4a6a-ae54-22819e4c4bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "a6f97582-065e-4df0-a583-0973a0103911", "address": "fa:16:3e:d7:31:79", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f97582-06", "ovs_interfaceid": "a6f97582-065e-4df0-a583-0973a0103911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG os_vif [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6f97582-06, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d55d690-f397-4ec6-b033-88edb56251e7) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:42 user nova-compute[75340]: INFO os_vif [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f97582-065e-4df0-a583-0973a0103911,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f97582-06')
Nov 30 09:34:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Deleting instance files /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9_del
Nov 30 09:34:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Deletion of /opt/stack/data/nova/instances/029a6160-a6bb-4a6a-ae54-22819e4c4bd9_del complete
Nov 30 09:34:42 user nova-compute[75340]: INFO nova.compute.manager [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 09:34:42 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:34:42 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:34:43 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:34:43 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Took 0.93 seconds to deallocate network for instance.
Nov 30 09:34:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:43 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:34:43 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:34:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:43 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Deleted allocations for instance 029a6160-a6bb-4a6a-ae54-22819e4c4bd9
Nov 30 09:34:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-60ff529d-b050-4e5a-823d-e7de6494dfac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:44 user nova-compute[75340]: INFO nova.compute.manager [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Terminating instance
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] Acquiring lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] Lock "029a6160-a6bb-4a6a-ae54-22819e4c4bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] No waiting events found dispatching network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:34:44 user nova-compute[75340]: WARNING nova.compute.manager [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received unexpected event network-vif-plugged-a6f97582-065e-4df0-a583-0973a0103911 for instance with vm_state deleted and task_state None.
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-a513efd4-6778-4d24-80ad-917903a0fd21 req-676ae174-23b7-4c5f-b640-8e714fdaf31f service nova] [instance: 029a6160-a6bb-4a6a-ae54-22819e4c4bd9] Received event network-vif-deleted-a6f97582-065e-4df0-a583-0973a0103911 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-unplugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] No waiting events found dispatching network-vif-unplugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-43e8889a-8f2d-4d4c-918b-e8c3a4ccecde req-fb875252-7288-4f77-9ae1-e3880cf12254 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-unplugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:34:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Instance destroyed successfully.
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lazy-loading 'resources' on Instance uuid fd49b4fa-b431-4846-b8d7-aa6913be4198 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1368844071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1368844',id=39,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9V1C3DIqUhqInmlyGHCsFQzNeRjHYMBKBzm+93OadGt1SDSYZ2DJA8OmshRTNorxWSRwJYzTtuTI/6q4dMRTm+mROtIt8MvkMcW6zWAN1pukG4aQeVk6QMl9q0ePde3A==',key_name='tempest-keypair-591454832',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:31:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74110c7abaf346768e6072a0a20054eb',ramdisk_id='',reservation_id='r-gyhfn0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0b5fc1373bb4fc684250079452f64d9',uuid=fd49b4fa-b431-4846-b8d7-aa6913be4198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converting VIF {"id": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "address": "fa:16:3e:a5:05:a8", "network": {"id": "5eefae8d-c755-4b38-a9d6-cdeb526da21f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-923977196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74110c7abaf346768e6072a0a20054eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ae019f-fe", "ovs_interfaceid": "96ae019f-fe4b-4739-8bcd-697e10e57ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG os_vif [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ae019f-fe, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8d36ed6-2421-438d-aed6-bdc2a98cd6b0) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:44 user nova-compute[75340]: INFO os_vif [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=96ae019f-fe4b-4739-8bcd-697e10e57ff0,network=Network(5eefae8d-c755-4b38-a9d6-cdeb526da21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ae019f-fe')
Nov 30 09:34:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Deleting instance files /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198_del
Nov 30 09:34:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Deletion of /opt/stack/data/nova/instances/fd49b4fa-b431-4846-b8d7-aa6913be4198_del complete
Nov 30 09:34:44 user nova-compute[75340]: INFO nova.compute.manager [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 09:34:44 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:34:44 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:34:45 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:34:45 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Took 0.85 seconds to deallocate network for instance.
Nov 30 09:34:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:34:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:46 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Deleted allocations for instance fd49b4fa-b431-4846-b8d7-aa6913be4198
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-9fb98664-8f10-476b-b770-b617e063396b tempest-TestServerVolumeAttachScenarioOldVersion-715747441 tempest-TestServerVolumeAttachScenarioOldVersion-715747441-project-member] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-8c735b2e-6fa1-488c-89ff-71047597197d req-523f0d4c-cca1-485e-96e9-1d3a4302ca74 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-deleted-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] Acquiring lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] Lock "fd49b4fa-b431-4846-b8d7-aa6913be4198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] No waiting events found dispatching network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:34:46 user nova-compute[75340]: WARNING nova.compute.manager [req-d459f259-8456-4853-ab03-3ce85a798513 req-26631053-9f3e-4e75-9cde-ea8d13e7ce21 service nova] [instance: fd49b4fa-b431-4846-b8d7-aa6913be4198] Received unexpected event network-vif-plugged-96ae019f-fe4b-4739-8bcd-697e10e57ff0 for instance with vm_state deleted and task_state None.
Nov 30 09:34:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:34:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:34:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:34:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:34:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:53 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 is timed out.
Nov 30 09:34:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdb from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the live domain config.
Nov 30 09:34:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMnoEfdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:34:53 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5912eb26-0e46-429a-b4ba-dbf1c50f163f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:34:53 user nova-compute[75340]: No targets found.
Nov 30 09:34:53 user nova-compute[75340]: iSNS:
Nov 30 09:34:53 user nova-compute[75340]: No targets found.
Nov 30 09:34:53 user nova-compute[75340]: STATIC:
Nov 30 09:34:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:34:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:34:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:34:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89
Nov 30 09:34:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:34:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:34:53 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d
Nov 30 09:34:53 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:34:53 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:34:53 user nova-compute[75340]: FIRMWARE:
Nov 30 09:34:53 user nova-compute[75340]: No targets found.
Nov 30 09:34:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:34:53 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:34:53 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d7a5d0-e936-499c-bf1f-bdfdb2d92e4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee79f8-3ded-4e6a-8331-f71f4b48eeb8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:53 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:53 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:34:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:34:53 user nova-compute[75340]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 (non-flash)
Nov 30 09:34:53 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:34:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff4814c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e31d90-7152-41be-8fe3-bc6ce32aaadf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0490b-4d09-4ef8-babc-4a20b3d7880f]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bcfb83-d315-496a-97bd-9337c876e3ed]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0701872-b0ba-4163-8768-be865c815518]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2ebbb-480f-4495-864b-b9f13b4a6fd7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e4c680-7532-473e-80d2-8f2c04c43e5d]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260]
Nov 30 09:34:53 user nova-compute[75340]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89, portal: 172.16.0.220,3260] successful.
Nov 30 09:34:53 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dbe6e3-4670-4625-8cd6-5a7a171e9a89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da0f6e7-28fe-4fde-b261-ca1774294942]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== disconnect_volume: return (373ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:53 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-3ec338ce-9f4e-481c-88e2-ca8a222e52f3 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.339s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:34:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:34:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:34:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8502MB free_disk=25.295547485351562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:34:55 user nova-compute[75340]: INFO nova.compute.manager [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Detaching volume 279f806b-a576-4ea5-a98c-05034ae7439d
Nov 30 09:34:55 user nova-compute[75340]: INFO nova.virt.block_device [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Attempting to driver detach volume 279f806b-a576-4ea5-a98c-05034ae7439d from mountpoint /dev/vdc
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Attempting to detach device vdc from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:34:55 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:55 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:34:55 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:34:55 user nova-compute[75340]:   <serial>279f806b-a576-4ea5-a98c-05034ae7439d</serial>
Nov 30 09:34:55 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:34:55 user nova-compute[75340]: </disk>
Nov 30 09:34:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:34:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdc from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the persistent domain config.
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:34:55 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:34:55 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:34:55 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:34:55 user nova-compute[75340]:   <serial>279f806b-a576-4ea5-a98c-05034ae7439d</serial>
Nov 30 09:34:55 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 09:34:55 user nova-compute[75340]: </disk>
Nov 30 09:34:55 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 59ea1092-6591-4aae-aabd-325ed17ac394 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:34:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:34:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:34:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:34:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:35:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 is timed out.
Nov 30 09:35:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully detached device vdc from instance 8d552527-2746-4f2d-9f50-4dbbf34558e7 from the live domain config.
Nov 30 09:35:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZFiDze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:35:15 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6df6e-84f9-4c1b-80c6-f3595f0fcd60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:35:15 user nova-compute[75340]: No targets found.
Nov 30 09:35:15 user nova-compute[75340]: iSNS:
Nov 30 09:35:15 user nova-compute[75340]: No targets found.
Nov 30 09:35:15 user nova-compute[75340]: STATIC:
Nov 30 09:35:15 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:35:15 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:35:15 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:35:15 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d
Nov 30 09:35:15 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:35:15 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:35:15 user nova-compute[75340]: FIRMWARE:
Nov 30 09:35:15 user nova-compute[75340]: No targets found.
Nov 30 09:35:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:35:15 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:35:15 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5375d-116d-45ff-bf14-cbceb0bc0c37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a85ed-4a8a-4db1-8680-5f3721b120b0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:35:15 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:35:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:35:15 user nova-compute[75340]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d (non-flash)
Nov 30 09:35:15 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff502bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d3bf3-8ad0-4911-9c6c-5ebf0aa9afe2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d5b48e-a434-476d-84aa-bf4fe6822f2d]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf5d4e-3532-41c4-9488-5db3aa7716a7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:35:15 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eacb4d1-c0ee-4de7-92e3-12dfb8407a39]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c96d4-2474-4d04-b38e-47e12dc8f91d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbad836-77b9-4962-ba74-3163a1180c52]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260]
Nov 30 09:35:16 user nova-compute[75340]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d, portal: 172.16.0.220,3260] successful.
Nov 30 09:35:16 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f806b-a576-4ea5-a98c-05034ae7439d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a0145-3c79-4612-b2bc-02818af1597d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] <== disconnect_volume: return (291ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:35:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'flavor' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6f547122-e1f5-43e6-9ec7-c2d36a5a6500 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:18 user nova-compute[75340]: INFO nova.compute.manager [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Terminating instance
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-unplugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] No waiting events found dispatching network-vif-unplugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.compute.manager [req-f357c823-bd17-4910-8069-cd7ff1c63bf8 req-1386e4cf-7eae-4fac-ab6e-0bad83b9c0ce service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-unplugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:35:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Instance destroyed successfully.
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lazy-loading 'resources' on Instance uuid 8d552527-2746-4f2d-9f50-4dbbf34558e7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2113409725',display_name='tempest-AttachVolumeTestJSON-server-2113409725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2113409725',id=41,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPFEiBYHdvFNzknqAvuHIjMulTH73kYG5sX57equ6KRJkJRwHm00Fty7tHz6/knGi8TOwPtGW3l2upBxBQuQLKzNuAuuYX5uI/D7oBsYNTJRQrCbxwe1yckwLEVlBXThw==',key_name='tempest-keypair-346445318',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cca9314cdc634dfa9df097fcd53c2c2c',ramdisk_id='',reservation_id='r-6wkqru12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-158840588',owner_user_name='tempest-AttachVolumeTestJSON-158840588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d13c8d8c984172a828f34deb3f9bf6',uuid=8d552527-2746-4f2d-9f50-4dbbf34558e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converting VIF {"id": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "address": "fa:16:3e:05:15:5b", "network": {"id": "290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1122447278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca9314cdc634dfa9df097fcd53c2c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb0fd9a-ff", "ovs_interfaceid": "9fb0fd9a-ffb2-412e-a524-8fe23cbb0399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG os_vif [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb0fd9a-ff, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a04b216-2d95-4ec3-b526-50435b4fef9e) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:18 user nova-compute[75340]: INFO os_vif [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:15:5b,bridge_name='br-int',has_traffic_filtering=True,id=9fb0fd9a-ffb2-412e-a524-8fe23cbb0399,network=Network(290b3cb8-9ba7-4bc1-9bbc-9db6146d0e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb0fd9a-ff')
Nov 30 09:35:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Deleting instance files /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7_del
Nov 30 09:35:18 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Deletion of /opt/stack/data/nova/instances/8d552527-2746-4f2d-9f50-4dbbf34558e7_del complete
Nov 30 09:35:19 user nova-compute[75340]: INFO nova.compute.manager [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 09:35:19 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:35:19 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:35:19 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:35:19 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:19 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Took 0.78 seconds to deallocate network for instance.
Nov 30 09:35:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-3ea7e5b7-319e-45f5-9699-2a9761e36f53 req-4b9ffe1b-8325-4df9-b711-0c7b52b81726 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-deleted-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:20 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Deleted allocations for instance 8d552527-2746-4f2d-9f50-4dbbf34558e7
Nov 30 09:35:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f6a25542-6d2a-470a-8eac-9201307aa916 tempest-AttachVolumeTestJSON-158840588 tempest-AttachVolumeTestJSON-158840588-project-member] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.065s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] Acquiring lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] Lock "8d552527-2746-4f2d-9f50-4dbbf34558e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] No waiting events found dispatching network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:20 user nova-compute[75340]: WARNING nova.compute.manager [req-79e30945-630e-491a-a981-3e8b3620aed2 req-db75ca91-2a65-4e2d-bce7-656f7bc5c557 service nova] [instance: 8d552527-2746-4f2d-9f50-4dbbf34558e7] Received unexpected event network-vif-plugged-9fb0fd9a-ffb2-412e-a524-8fe23cbb0399 for instance with vm_state deleted and task_state None.
Nov 30 09:35:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing instance network info cache due to event network-changed-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] Acquiring lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] Acquired lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG nova.network.neutron [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Refreshing network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:24 user nova-compute[75340]: INFO nova.compute.manager [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Terminating instance
Nov 30 09:35:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updated VIF entry in instance network info cache for port e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.network.neutron [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [{"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Instance destroyed successfully.
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lazy-loading 'resources' on Instance uuid 06803cbd-89e9-40c6-90fe-cdb61836e4d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-256984797',display_name='tempest-TestShelveInstance-server-256984797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-256984797',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4tX1juoszHD+LgbJiLCUWaNOcoqhH5w5hk17UFwDFfUS/9EREkMw42nljfwLj3/IkcRNpJnl0isRswatJxczgJ13HEsFrQPFPiUvjn71dOpijedxa2rYoeQeKWSPPf9Q==',key_name='tempest-TestShelveInstance-1377343270',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1a9ce07006430d92f23d4161b70f01',ramdisk_id='',reservation_id='r-2auh1l0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-187239747',owner_user_name='tempest-TestShelveInstance-187239747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:33:52Z,user_data=None,user_id='167a6f85251d4513b9953681ac119e66',uuid=06803cbd-89e9-40c6-90fe-cdb61836e4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converting VIF {"id": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "address": "fa:16:3e:fb:98:b2", "network": {"id": "5f0c24a1-4d96-4e93-b65d-ea08950d5fc4", "bridge": "br-int", "label": "tempest-TestShelveInstance-200677852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1a9ce07006430d92f23d4161b70f01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c43f9-1b", "ovs_interfaceid": "e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_vif [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6f0d5d81-6e50-44c2-9a51-68db234e8c51 req-88d11ca0-6a91-4f02-8de9-06f3dc5cd6bc service nova] Releasing lock "refresh_cache-06803cbd-89e9-40c6-90fe-cdb61836e4d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87c43f9-1b, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0b797bd-ab0d-418e-b88d-144e614ef77e) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:25 user nova-compute[75340]: INFO os_vif [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:98:b2,bridge_name='br-int',has_traffic_filtering=True,id=e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8,network=Network(5f0c24a1-4d96-4e93-b65d-ea08950d5fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c43f9-1b')
Nov 30 09:35:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqLgQrTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:35:25 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026163d-66e9-4a78-a727-b8448f97a53c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:35:25 user nova-compute[75340]: No targets found.
Nov 30 09:35:25 user nova-compute[75340]: iSNS:
Nov 30 09:35:25 user nova-compute[75340]: No targets found.
Nov 30 09:35:25 user nova-compute[75340]: STATIC:
Nov 30 09:35:25 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35
Nov 30 09:35:25 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:35:25 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:35:25 user nova-compute[75340]: FIRMWARE:
Nov 30 09:35:25 user nova-compute[75340]: No targets found.
Nov 30 09:35:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:35:25 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:35:25 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4fb5e1-4154-4e16-a7e7-fac8ae0a905a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cd3051-b99d-4cde-888c-0e1b5d593773]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:35:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 (non-flash)
Nov 30 09:35:25 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305c4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2544a-877b-4bea-b345-26e34255bc63]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fac3fe-8871-40fb-a5a6-c15d5f2b809b]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fbc8b3-cfe5-48ab-9d18-413d2759ec4a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:35:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c22dadf-2aa8-41d5-a6f9-f12cd785a939]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84704dfe-1cda-40dc-8855-68568c23a12b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03b0e2-989d-4e1f-b8d9-97ec082deff5]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260]
Nov 30 09:35:26 user nova-compute[75340]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35, portal: 172.16.0.220,3260] successful.
Nov 30 09:35:26 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2be1b3-b3c4-43be-acf2-44261f483f35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82549d-73a8-421d-8d08-a4ae0fa12536]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] <== disconnect_volume: return (334ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:35:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deleting instance files /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7_del
Nov 30 09:35:26 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deletion of /opt/stack/data/nova/instances/06803cbd-89e9-40c6-90fe-cdb61836e4d7_del complete
Nov 30 09:35:26 user nova-compute[75340]: INFO nova.compute.manager [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:26 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Took 0.47 seconds to deallocate network for instance.
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-ea673669-c344-4c01-aac4-b3bf1752f948 req-5d71412f-8bf5-477e-98c4-cdb28c6c6d95 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-deleted-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-unplugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Acquiring lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:26 user nova-compute[75340]: DEBUG nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] No waiting events found dispatching network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:26 user nova-compute[75340]: WARNING nova.compute.manager [req-297ad6d7-8855-478b-bdf3-fc12e932eae3 req-a65b750f-4303-4c27-96a0-26c82fdf4455 service nova] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Received unexpected event network-vif-plugged-e87c43f9-1bb4-4d7c-ae5f-6815255f6fb8 for instance with vm_state active and task_state deleting.
Nov 30 09:35:27 user nova-compute[75340]: INFO nova.compute.manager [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 09:35:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] [instance: 06803cbd-89e9-40c6-90fe-cdb61836e4d7] Deleting volume: bb2be1b3-b3c4-43be-acf2-44261f483f35 {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:27 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Deleted allocations for instance 06803cbd-89e9-40c6-90fe-cdb61836e4d7
Nov 30 09:35:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-611d2213-15f0-4e09-aed6-f7f8e8112a8f tempest-TestShelveInstance-187239747 tempest-TestShelveInstance-187239747-project-member] Lock "06803cbd-89e9-40c6-90fe-cdb61836e4d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.976s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:32 user nova-compute[75340]: INFO nova.compute.manager [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Terminating instance
Nov 30 09:35:32 user nova-compute[75340]: DEBUG nova.compute.manager [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-f5ba9c97-ab15-4199-b9e2-85a6fca229f7 req-fbc06f92-cecc-4520-b64c-56a071f08012 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-unplugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Instance destroyed successfully.
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.objects.instance [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lazy-loading 'resources' on Instance uuid 59ea1092-6591-4aae-aabd-325ed17ac394 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1711078597',display_name='tempest-ServerRescueNegativeTestJSON-server-1711078597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1711078597',id=19,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba97ab8c36f4de8ba045c19af810242',ramdisk_id='',reservation_id='r-4k020rwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1146573411',owner_user_name='tempest-ServerRescueNegativeTestJSON-1146573411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:25:10Z,user_data=None,user_id='221aef7b87f64a96a9fa77bcec0834ca',uuid=59ea1092-6591-4aae-aabd-325ed17ac394,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converting VIF {"id": "127608c1-d377-41d8-878e-8e3cec2f14d6", "address": "fa:16:3e:5a:01:00", "network": {"id": "004cd7da-65f4-4a1a-a853-d6572a6ec646", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260122613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba97ab8c36f4de8ba045c19af810242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127608c1-d3", "ovs_interfaceid": "127608c1-d377-41d8-878e-8e3cec2f14d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG os_vif [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127608c1-d3, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3877d2eb-d372-4b4e-8d11-067821b0fcc8) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:33 user nova-compute[75340]: INFO os_vif [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:01:00,bridge_name='br-int',has_traffic_filtering=True,id=127608c1-d377-41d8-878e-8e3cec2f14d6,network=Network(004cd7da-65f4-4a1a-a853-d6572a6ec646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127608c1-d3')
Nov 30 09:35:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Deleting instance files /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394_del
Nov 30 09:35:33 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Deletion of /opt/stack/data/nova/instances/59ea1092-6591-4aae-aabd-325ed17ac394_del complete
Nov 30 09:35:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:33 user nova-compute[75340]: INFO nova.compute.manager [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 09:35:33 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:35:33 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:34 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Took 0.59 seconds to deallocate network for instance.
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-4113b17a-33c9-4dc7-8ccd-c46b8d868390 req-0b911faa-2d42-4262-a9eb-56e2febaeb62 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-deleted-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:34 user nova-compute[75340]: INFO nova.compute.manager [req-4113b17a-33c9-4dc7-8ccd-c46b8d868390 req-0b911faa-2d42-4262-a9eb-56e2febaeb62 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Neutron deleted interface 127608c1-d377-41d8-878e-8e3cec2f14d6; detaching it from the instance and deleting it from the info cache
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.network.neutron [req-4113b17a-33c9-4dc7-8ccd-c46b8d868390 req-0b911faa-2d42-4262-a9eb-56e2febaeb62 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.compute.manager [req-4113b17a-33c9-4dc7-8ccd-c46b8d868390 req-0b911faa-2d42-4262-a9eb-56e2febaeb62 service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Detach interface failed, port_id=127608c1-d377-41d8-878e-8e3cec2f14d6, reason: Instance 59ea1092-6591-4aae-aabd-325ed17ac394 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:34 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Deleted allocations for instance 59ea1092-6591-4aae-aabd-325ed17ac394
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8b06c304-5035-4744-9ec3-ba217ff3cbac tempest-ServerRescueNegativeTestJSON-1146573411 tempest-ServerRescueNegativeTestJSON-1146573411-project-member] Lock "59ea1092-6591-4aae-aabd-325ed17ac394" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.956s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:34 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:35:34 user nova-compute[75340]: INFO nova.compute.claims [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Claim successful on node user
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:35 user nova-compute[75340]: WARNING nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state deleted and task_state None.
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Acquiring lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] Lock "59ea1092-6591-4aae-aabd-325ed17ac394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] No waiting events found dispatching network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:35 user nova-compute[75340]: WARNING nova.compute.manager [req-cc8a6c1e-80f3-45b5-a430-7cb8bbaca660 req-ad2b6b3d-c797-4b82-9e59-849b98249ccc service nova] [instance: 59ea1092-6591-4aae-aabd-325ed17ac394] Received unexpected event network-vif-plugged-127608c1-d377-41d8-878e-8e3cec2f14d6 for instance with vm_state deleted and task_state None.
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:35:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.policy [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bbb4a25e58849c89e71d22727b082b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c44e90da98479fb459142c4acb01ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:35:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Creating image(s)
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "670783bcc132813059ef65f8db89ecd5862e3ef0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "670783bcc132813059ef65f8db89ecd5862e3ef0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG nova.virt.images [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] 85cd8986-7951-4a52-a0f5-e27a7d393f72 was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.part /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.part /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.converted" returned: 0 in 0.248s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Successfully created port: 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "670783bcc132813059ef65f8db89ecd5862e3ef0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.139s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "670783bcc132813059ef65f8db89ecd5862e3ef0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "670783bcc132813059ef65f8db89ecd5862e3ef0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0,backing_fmt=raw /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0,backing_fmt=raw /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk 1073741824" returned: 0 in 0.052s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "670783bcc132813059ef65f8db89ecd5862e3ef0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json" returned: 0 in 0.201s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Cannot resize image /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Ensure instance console log exists: /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Successfully updated port: 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing instance network info cache due to event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:38 user nova-compute[75340]: INFO nova.compute.manager [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Unshelving
Nov 30 09:35:38 user nova-compute[75340]: INFO nova.virt.block_device [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Booting with volume 1ef9c365-cce5-4437-950d-bcf7e1ee869e at /dev/vdc
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.utils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52be18b-77df-4fd2-b430-7776aaf17ae4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f2b42-86f9-4c50-aad7-8d5c07146055]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff22df6-2d8e-4006-8893-34103851c000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7268c568-2f3e-4645-b229-037050aa0a2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:35:38 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9055c74d-6813-472a-b385-02b62131697a]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG os_brick.utils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating existing volume attachment record: 0fdf3725-d8b0-48cc-bbf8-528890a39aa6 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance network_info: |[{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.network.neutron [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start _get_guest_xml network_info=[{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:35:31Z,direct_url=<?>,disk_format='qcow2',id=85cd8986-7951-4a52-a0f5-e27a7d393f72,min_disk=0,min_ram=0,name='tempest-scenario-img--856398845',owner='59c44e90da98479fb459142c4acb01ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:35:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '85cd8986-7951-4a52-a0f5-e27a7d393f72'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:35:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:35:31Z,direct_url=<?>,disk_format='qcow2',id=85cd8986-7951-4a52-a0f5-e27a7d393f72,min_disk=0,min_ram=0,name='tempest-scenario-img--856398845',owner='59c44e90da98479fb459142c4acb01ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:35:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:35:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:35Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.objects.instance [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'pci_devices' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:35:39 user nova-compute[75340]:   <uuid>e6828092-aa0c-48fd-866c-ac832b080938</uuid>
Nov 30 09:35:39 user nova-compute[75340]:   <name>instance-0000002a</name>
Nov 30 09:35:39 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:35:39 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:35:39 user nova-compute[75340]:   <metadata>
Nov 30 09:35:39 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:35:39 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:name>tempest-TestMinimumBasicScenario-server-87139045</nova:name>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:35:38</nova:creationTime>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:35:39 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:35:39 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:owner>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:user uuid="0bbb4a25e58849c89e71d22727b082b7">tempest-TestMinimumBasicScenario-627001043-project-member</nova:user>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:project uuid="59c44e90da98479fb459142c4acb01ea">tempest-TestMinimumBasicScenario-627001043</nova:project>
Nov 30 09:35:39 user nova-compute[75340]:       </nova:owner>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:root type="image" uuid="85cd8986-7951-4a52-a0f5-e27a7d393f72"/>
Nov 30 09:35:39 user nova-compute[75340]:       <nova:ports>
Nov 30 09:35:39 user nova-compute[75340]:         <nova:port uuid="2929a82b-85c5-4f89-bfa5-15df6cb1cb7d">
Nov 30 09:35:39 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:35:39 user nova-compute[75340]:         </nova:port>
Nov 30 09:35:39 user nova-compute[75340]:       </nova:ports>
Nov 30 09:35:39 user nova-compute[75340]:     </nova:instance>
Nov 30 09:35:39 user nova-compute[75340]:   </metadata>
Nov 30 09:35:39 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:35:39 user nova-compute[75340]:     <system>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="serial">e6828092-aa0c-48fd-866c-ac832b080938</entry>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="uuid">e6828092-aa0c-48fd-866c-ac832b080938</entry>
Nov 30 09:35:39 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:35:39 user nova-compute[75340]:     </system>
Nov 30 09:35:39 user nova-compute[75340]:   </sysinfo>
Nov 30 09:35:39 user nova-compute[75340]:   <os>
Nov 30 09:35:39 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:35:39 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:35:39 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:35:39 user nova-compute[75340]:   </os>
Nov 30 09:35:39 user nova-compute[75340]:   <features>
Nov 30 09:35:39 user nova-compute[75340]:     <acpi/>
Nov 30 09:35:39 user nova-compute[75340]:     <apic/>
Nov 30 09:35:39 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:35:39 user nova-compute[75340]:   </features>
Nov 30 09:35:39 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:35:39 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:35:39 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:35:39 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:35:39 user nova-compute[75340]:   </clock>
Nov 30 09:35:39 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:35:39 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:35:39 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:35:39 user nova-compute[75340]:   </cpu>
Nov 30 09:35:39 user nova-compute[75340]:   <devices>
Nov 30 09:35:39 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:35:39 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:35:39 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk"/>
Nov 30 09:35:39 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:35:39 user nova-compute[75340]:     </disk>
Nov 30 09:35:39 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:35:39 user nova-compute[75340]:       <mac address="fa:16:3e:53:ec:44"/>
Nov 30 09:35:39 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:35:39 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:35:39 user nova-compute[75340]:       <target dev="tap2929a82b-85"/>
Nov 30 09:35:39 user nova-compute[75340]:     </interface>
Nov 30 09:35:39 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:35:39 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/console.log" append="off"/>
Nov 30 09:35:39 user nova-compute[75340]:     </serial>
Nov 30 09:35:39 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:35:39 user nova-compute[75340]:     <video>
Nov 30 09:35:39 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:35:39 user nova-compute[75340]:     </video>
Nov 30 09:35:39 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:35:39 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:35:39 user nova-compute[75340]:     </rng>
Nov 30 09:35:39 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:35:39 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:35:39 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:35:39 user nova-compute[75340]:     </memballoon>
Nov 30 09:35:39 user nova-compute[75340]:   </devices>
Nov 30 09:35:39 user nova-compute[75340]: </domain>
Nov 30 09:35:39 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:35Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG os_vif [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6af152b-4f49-51d7-a03e-479bc7bd9fe9', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2929a82b-85, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2929a82b-85, col_values=(('qos', UUID('ef7f8c87-a11a-4d64-bb8f-6378d3f341ce')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2929a82b-85, col_values=(('external_ids', {'iface-id': '2929a82b-85c5-4f89-bfa5-15df6cb1cb7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ec:44', 'vm-uuid': 'e6828092-aa0c-48fd-866c-ac832b080938'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: INFO os_vif [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85')
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No VIF found with MAC fa:16:3e:53:ec:44, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.neutron [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated VIF entry in instance network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG nova.network.neutron [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b670dea9-77cb-40bc-9a8c-580943b90fd9 req-5e2338fd-171f-4663-a4b8-46d2f7489888 service nova] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:40 user nova-compute[75340]: WARNING nova.compute.manager [req-96b72c5d-51c8-49ee-b08c-ac908cbf0dd2 req-d437c07f-fb61-499c-b1b4-92c05b6322cd service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state building and task_state spawning.
Nov 30 09:35:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:35:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance spawned successfully.
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:35:43 user nova-compute[75340]: WARNING nova.compute.manager [req-bbe2ab5d-5fe4-4621-a064-788d6b497d4a req-bdb44eca-e971-42c3-9f78-09c7db49b826 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state building and task_state spawning.
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:35:43 user nova-compute[75340]: INFO nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Took 7.71 seconds to spawn the instance on the hypervisor.
Nov 30 09:35:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:35:43 user nova-compute[75340]: INFO nova.compute.manager [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Took 8.32 seconds to build instance.
Nov 30 09:35:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-980f5a70-250f-4dff-a667-06db487dc898 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.430s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:45 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:35:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_requests' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'numa_topology' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:35:49 user nova-compute[75340]: INFO nova.compute.claims [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Claim successful on node user
Nov 30 09:35:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:35:49 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:50 user nova-compute[75340]: INFO nova.network.neutron [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating port bc9cdba3-3512-49eb-9fdc-29711f03c709 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing instance network info cache due to event network-changed-bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:35:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:35:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Creating image(s)
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG nova.network.neutron [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Refreshing network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG nova.objects.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<c3814f52-db11-4fb4-b272-c5cf794511f2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "83602ae0fcb9610d139b826ce234739a483d325d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "83602ae0fcb9610d139b826ce234739a483d325d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG nova.virt.images [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] 5f3ba9ce-6ade-414b-9a2b-876e9f09af77 was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:35:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.part /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG nova.network.neutron [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updated VIF entry in instance network info cache for port bc9cdba3-3512-49eb-9fdc-29711f03c709. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG nova.network.neutron [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-935a1d94-b731-4a81-a944-dacd9354f5fa req-6e499102-da46-4f57-9e69-badd5915c002 service nova] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.part /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.converted" returned: 0 in 0.873s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "83602ae0fcb9610d139b826ce234739a483d325d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.496s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:53 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json" returned: 0 in 0.208s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "83602ae0fcb9610d139b826ce234739a483d325d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "83602ae0fcb9610d139b826ce234739a483d325d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d,backing_fmt=raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d,backing_fmt=raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk 1073741824" returned: 0 in 0.070s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "83602ae0fcb9610d139b826ce234739a483d325d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'migration_context' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG nova.objects.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<c3814f52-db11-4fb4-b272-c5cf794511f2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:35:54 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Rebasing disk image.
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb -F raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:35:55 user nova-compute[75340]: INFO nova.compute.claims [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Claim successful on node user
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:35:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:55 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=25.180923461914062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.policy [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:35:55 user nova-compute[75340]: INFO nova.virt.block_device [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Booting with volume snapshot 7dbd44ac-2525-4b09-a9ae-bdbb55445b86 at /dev/vda
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e6828092-aa0c-48fd-866c-ac832b080938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (0b79bb92-a015-438b-9e5d-504678a00853): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e0b486f0-cf2a-48ae-8d0b-6cd83316b25e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:35:55 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:35:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:35:56 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:35:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:35:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:35:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Successfully created port: 3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb -F raw /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk" returned: 0 in 2.862s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Ensure instance console log exists: /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start _get_guest_xml network_info=[{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='956651f56ad9d2cd3b577c4332152712',container_format='bare',created_at=2023-11-30T09:33:46Z,direct_url=<?>,disk_format='qcow2',id=5f3ba9ce-6ade-414b-9a2b-876e9f09af77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1975615668-shelved',owner='a90a6d95b1ed43879eca5e07be0a4276',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T09:33:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '0fdf3725-d8b0-48cc-bbf8-528890a39aa6', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkruRbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c3814f52-db11-4fb4-b272-c5cf794511f2', 'attached_at': '', 'detached_at': '', 'volume_id': '1ef9c365-cce5-4437-950d-bcf7e1ee869e', 'serial': '1ef9c365-cce5-4437-950d-bcf7e1ee869e'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:35:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='956651f56ad9d2cd3b577c4332152712',container_format='bare',created_at=2023-11-30T09:33:46Z,direct_url=<?>,disk_format='qcow2',id=5f3ba9ce-6ade-414b-9a2b-876e9f09af77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1975615668-shelved',owner='a90a6d95b1ed43879eca5e07be0a4276',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T09:33:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.objects.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<c3814f52-db11-4fb4-b272-c5cf794511f2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkruRbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:35:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:35:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:35:57 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1184de-8c7b-4c86-9096-3bba53033601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:35:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a94bdc-9150-4998-ac55-a813e3c1e8c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e] added
Nov 30 09:35:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a20fa-4997-4ec6-a2ee-3cff50802bfc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2db33-222a-4a83-a872-6840405f1935]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkruRbLM {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkruRbLM" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[00438a90-31a9-43af-a9a3-ebedc6097d8e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkruRbLM'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Successfully updated port: 3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1df1e7-4538-41ef-8bc5-022f00b432d4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5a5a44-e08f-4783-a959-830c19d37ce0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:35:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:35:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:35:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:35:57 user nova-compute[75340]: 
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-changed-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Refreshing instance network info cache due to event network-changed-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] Acquiring lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff6febf-66c1-48b5-a074-ce0823c44410]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260]
Nov 30 09:35:57 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260] successful.
Nov 30 09:35:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf2ba6d-713d-4656-84bd-3b67c35aaf83]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd463a-0bdc-4950-a0b3-3df96cd92eff]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:35:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:35:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b729f-c07d-496c-9063-e7d06436ac5a]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkruRbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updating instance_info_cache with network_info: [{"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Instance network_info: |[{"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] Acquired lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Refreshing network info cache for port 3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updated VIF entry in instance network info cache for port 3ce0298f-56d3-4b6d-9a0c-97cc0fba832b. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updating instance_info_cache with network_info: [{"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4aaced55-346c-4c60-807f-77426855e018 req-758f9329-80fd-4caf-9af6-2c6bbabdb622 service nova] Releasing lock "refresh_cache-e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26166363362646565', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166363362646565', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='5f3ba9ce-6ade-414b-9a2b-876e9f09af77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-264695344',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:33:49.927408',shelved_host='user',shelved_image_id='5f3ba9ce-6ade-414b-9a2b-876e9f09af77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_devices' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.objects.base [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<c3814f52-db11-4fb4-b272-c5cf794511f2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:35:59 user nova-compute[75340]:   <uuid>c3814f52-db11-4fb4-b272-c5cf794511f2</uuid>
Nov 30 09:35:59 user nova-compute[75340]:   <name>instance-00000028</name>
Nov 30 09:35:59 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:35:59 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:35:59 user nova-compute[75340]:   <metadata>
Nov 30 09:35:59 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:35:59 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1975615668</nova:name>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:35:57</nova:creationTime>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:35:59 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:35:59 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:owner>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:user uuid="34a31aeeca154620ba74acbaaabcdced">tempest-AttachVolumeShelveTestJSON-1052742553-project-member</nova:user>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:project uuid="a90a6d95b1ed43879eca5e07be0a4276">tempest-AttachVolumeShelveTestJSON-1052742553</nova:project>
Nov 30 09:35:59 user nova-compute[75340]:       </nova:owner>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:root type="image" uuid="5f3ba9ce-6ade-414b-9a2b-876e9f09af77"/>
Nov 30 09:35:59 user nova-compute[75340]:       <nova:ports>
Nov 30 09:35:59 user nova-compute[75340]:         <nova:port uuid="bc9cdba3-3512-49eb-9fdc-29711f03c709">
Nov 30 09:35:59 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 09:35:59 user nova-compute[75340]:         </nova:port>
Nov 30 09:35:59 user nova-compute[75340]:       </nova:ports>
Nov 30 09:35:59 user nova-compute[75340]:     </nova:instance>
Nov 30 09:35:59 user nova-compute[75340]:   </metadata>
Nov 30 09:35:59 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:35:59 user nova-compute[75340]:     <system>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="serial">c3814f52-db11-4fb4-b272-c5cf794511f2</entry>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="uuid">c3814f52-db11-4fb4-b272-c5cf794511f2</entry>
Nov 30 09:35:59 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:35:59 user nova-compute[75340]:     </system>
Nov 30 09:35:59 user nova-compute[75340]:   </sysinfo>
Nov 30 09:35:59 user nova-compute[75340]:   <os>
Nov 30 09:35:59 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:35:59 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:35:59 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:35:59 user nova-compute[75340]:   </os>
Nov 30 09:35:59 user nova-compute[75340]:   <features>
Nov 30 09:35:59 user nova-compute[75340]:     <acpi/>
Nov 30 09:35:59 user nova-compute[75340]:     <apic/>
Nov 30 09:35:59 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:35:59 user nova-compute[75340]:   </features>
Nov 30 09:35:59 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:35:59 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:35:59 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:35:59 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:35:59 user nova-compute[75340]:   </clock>
Nov 30 09:35:59 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:35:59 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:35:59 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:35:59 user nova-compute[75340]:   </cpu>
Nov 30 09:35:59 user nova-compute[75340]:   <devices>
Nov 30 09:35:59 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:35:59 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:35:59 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk"/>
Nov 30 09:35:59 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:35:59 user nova-compute[75340]:     </disk>
Nov 30 09:35:59 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:35:59 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:35:59 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:35:59 user nova-compute[75340]:       <target dev="vdc" bus="virtio"/>
Nov 30 09:35:59 user nova-compute[75340]:       <serial>1ef9c365-cce5-4437-950d-bcf7e1ee869e</serial>
Nov 30 09:35:59 user nova-compute[75340]:     </disk>
Nov 30 09:35:59 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:35:59 user nova-compute[75340]:       <mac address="fa:16:3e:96:a7:c0"/>
Nov 30 09:35:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:35:59 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:35:59 user nova-compute[75340]:       <target dev="tapbc9cdba3-35"/>
Nov 30 09:35:59 user nova-compute[75340]:     </interface>
Nov 30 09:35:59 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:35:59 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/console.log" append="off"/>
Nov 30 09:35:59 user nova-compute[75340]:     </serial>
Nov 30 09:35:59 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:35:59 user nova-compute[75340]:     <video>
Nov 30 09:35:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:35:59 user nova-compute[75340]:     </video>
Nov 30 09:35:59 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:35:59 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:35:59 user nova-compute[75340]:     </rng>
Nov 30 09:35:59 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:35:59 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:35:59 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:35:59 user nova-compute[75340]:     </memballoon>
Nov 30 09:35:59 user nova-compute[75340]:   </devices>
Nov 30 09:35:59 user nova-compute[75340]: </domain>
Nov 30 09:35:59 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='5f3ba9ce-6ade-414b-9a2b-876e9f09af77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-264695344',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:33:49.927408',shelved_host='user',shelved_image_id='5f3ba9ce-6ade-414b-9a2b-876e9f09af77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG os_vif [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7632ef-9f37-5cac-b094-c800226beb0b', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9cdba3-35, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9cdba3-35, col_values=(('qos', UUID('04f0060d-e974-4d8d-b7dc-29728c3f69fc')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9cdba3-35, col_values=(('external_ids', {'iface-id': 'bc9cdba3-3512-49eb-9fdc-29711f03c709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:a7:c0', 'vm-uuid': 'c3814f52-db11-4fb4-b272-c5cf794511f2'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:35:59 user nova-compute[75340]: INFO os_vif [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35')
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No VIF found with MAC fa:16:3e:96:a7:c0, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:35:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:36:00 user nova-compute[75340]: WARNING nova.compute.manager [req-461c629e-23d0-4bdc-83e8-d3378d812940 req-ea6e92ab-c56d-4cf7-abc8-1423d6c64c83 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:36:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:36:02 user nova-compute[75340]: WARNING nova.compute.manager [req-476a7b6d-428b-406c-a310-40f90bd1ffec req-23a0d4fd-d7b9-4dbc-9563-bf6f8004f8ba service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:36:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:36:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:36:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance spawned successfully.
Nov 30 09:36:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:36:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd85e34c-c851-48de-959e-e99ae38ad3d7 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.753s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.utils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[448eb700-67b2-4cb1-9290-3ed718b5b356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcee239-d7b3-433e-af5e-5b200639de67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c8153-1f86-46a7-8abd-5c2ab1976934]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e67f658-11ed-44d7-a0d7-0e6be1afd8f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:36:07 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:36:07 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae579b05-e671-4e04-ac57-2c4dafe8e71f]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG os_brick.utils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:36:07 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updating existing volume attachment record: 6ae9c8a6-7823-4e00-b97e-9ce4c157d627 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:36:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:36:17 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Creating image(s)
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Ensure instance console log exists: /opt/stack/data/nova/instances/e0b486f0-cf2a-48ae-8d0b-6cd83316b25e/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Start _get_guest_xml network_info=[{"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '6ae9c8a6-7823-4e00-b97e-9ce4c157d627', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhWDXIbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0b486f0-cf2a-48ae-8d0b-6cd83316b25e', 'attached_at': '', 'detached_at': '', 'volume_id': '47e81371-e322-4717-95c5-90aac3b751d2', 'serial': '47e81371-e322-4717-95c5-90aac3b751d2'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:36:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:17 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhWDXIbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:36:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:36:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:36:17 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee9f4c4-faf3-4562-ae69-ad9a315da85f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:36:17 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[752cf1a3-300e-4388-94a1-656a1e88f879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2] added
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f10b7-ed7e-4fce-8c31-b8840a9a144a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c54cf-81b5-4672-99e1-1a0d23abf589]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhWDXIbz {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhWDXIbz" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aec05c3-419d-4b57-9cab-6138e1e8f17a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yhWDXIbz'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba21ed-a6e2-496e-968c-ccdb33d80193]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f315ad5-9cba-41ad-a3f1-eb01323f5f8e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3c468-2748-4e7f-9172-99db919871f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260]
Nov 30 09:36:17 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51440d5-67ac-488e-ba0a-774ed194ba78]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.062s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d825e-f080-4e94-8243-ec4159589f98]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:36:17 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:36:17 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:36:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ab976-9067-4646-a4cd-68cf24e582fd]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:36:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhWDXIbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26637313634613939', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637313634613939', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116933392',display_name='tempest-TestVolumeBootPattern-server-1116933392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116933392',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-447c7r7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:56Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=e0b486f0-cf2a-48ae-8d0b-6cd83316b25e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid e0b486f0-cf2a-48ae-8d0b-6cd83316b25e {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:36:18 user nova-compute[75340]:   <uuid>e0b486f0-cf2a-48ae-8d0b-6cd83316b25e</uuid>
Nov 30 09:36:18 user nova-compute[75340]:   <name>instance-0000002b</name>
Nov 30 09:36:18 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:36:18 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:36:18 user nova-compute[75340]:   <metadata>
Nov 30 09:36:18 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:36:18 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:36:18 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-server-1116933392</nova:name>
Nov 30 09:36:18 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:36:17</nova:creationTime>
Nov 30 09:36:18 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:36:18 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:36:18 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:36:18 user nova-compute[75340]:       <nova:owner>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:36:18 user nova-compute[75340]:       </nova:owner>
Nov 30 09:36:18 user nova-compute[75340]:       <nova:ports>
Nov 30 09:36:18 user nova-compute[75340]:         <nova:port uuid="3ce0298f-56d3-4b6d-9a0c-97cc0fba832b">
Nov 30 09:36:18 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 09:36:18 user nova-compute[75340]:         </nova:port>
Nov 30 09:36:18 user nova-compute[75340]:       </nova:ports>
Nov 30 09:36:18 user nova-compute[75340]:     </nova:instance>
Nov 30 09:36:18 user nova-compute[75340]:   </metadata>
Nov 30 09:36:18 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:36:18 user nova-compute[75340]:     <system>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="serial">e0b486f0-cf2a-48ae-8d0b-6cd83316b25e</entry>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="uuid">e0b486f0-cf2a-48ae-8d0b-6cd83316b25e</entry>
Nov 30 09:36:18 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:36:18 user nova-compute[75340]:     </system>
Nov 30 09:36:18 user nova-compute[75340]:   </sysinfo>
Nov 30 09:36:18 user nova-compute[75340]:   <os>
Nov 30 09:36:18 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:36:18 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:36:18 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:36:18 user nova-compute[75340]:   </os>
Nov 30 09:36:18 user nova-compute[75340]:   <features>
Nov 30 09:36:18 user nova-compute[75340]:     <acpi/>
Nov 30 09:36:18 user nova-compute[75340]:     <apic/>
Nov 30 09:36:18 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:36:18 user nova-compute[75340]:   </features>
Nov 30 09:36:18 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:36:18 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:36:18 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:36:18 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:36:18 user nova-compute[75340]:   </clock>
Nov 30 09:36:18 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:36:18 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:36:18 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:36:18 user nova-compute[75340]:   </cpu>
Nov 30 09:36:18 user nova-compute[75340]:   <devices>
Nov 30 09:36:18 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:36:18 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:36:18 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:36:18 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:36:18 user nova-compute[75340]:       <serial>47e81371-e322-4717-95c5-90aac3b751d2</serial>
Nov 30 09:36:18 user nova-compute[75340]:     </disk>
Nov 30 09:36:18 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:36:18 user nova-compute[75340]:       <mac address="fa:16:3e:27:89:15"/>
Nov 30 09:36:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:36:18 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:36:18 user nova-compute[75340]:       <target dev="tap3ce0298f-56"/>
Nov 30 09:36:18 user nova-compute[75340]:     </interface>
Nov 30 09:36:18 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:36:18 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/e0b486f0-cf2a-48ae-8d0b-6cd83316b25e/console.log" append="off"/>
Nov 30 09:36:18 user nova-compute[75340]:     </serial>
Nov 30 09:36:18 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:36:18 user nova-compute[75340]:     <video>
Nov 30 09:36:18 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:36:18 user nova-compute[75340]:     </video>
Nov 30 09:36:18 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:36:18 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:36:18 user nova-compute[75340]:     </rng>
Nov 30 09:36:18 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:36:18 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:36:18 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:36:18 user nova-compute[75340]:     </memballoon>
Nov 30 09:36:18 user nova-compute[75340]:   </devices>
Nov 30 09:36:18 user nova-compute[75340]: </domain>
Nov 30 09:36:18 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116933392',display_name='tempest-TestVolumeBootPattern-server-1116933392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116933392',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-447c7r7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:35:56Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=e0b486f0-cf2a-48ae-8d0b-6cd83316b25e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG os_vif [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ab655bf-21a9-5ad3-b43b-44869df987a5', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce0298f-56, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce0298f-56, col_values=(('qos', UUID('f9bc0651-5143-4052-881e-b3c875a1a30c')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce0298f-56, col_values=(('external_ids', {'iface-id': '3ce0298f-56d3-4b6d-9a0c-97cc0fba832b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:89:15', 'vm-uuid': 'e0b486f0-cf2a-48ae-8d0b-6cd83316b25e'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:18 user nova-compute[75340]: INFO os_vif [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56')
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:36:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:27:89:15, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:36:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] No waiting events found dispatching network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:36:20 user nova-compute[75340]: WARNING nova.compute.manager [req-b1d2f144-4ba5-46d5-ab3e-de51151ffb0b req-b1f9d952-3d3b-4c03-b383-0aa67c4bef99 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received unexpected event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b for instance with vm_state building and task_state spawning.
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] No waiting events found dispatching network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:36:22 user nova-compute[75340]: WARNING nova.compute.manager [req-79d84f10-674f-4140-b909-9ac2cd4085bf req-9eade3ee-1b52-44e3-aed4-8b0970247413 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received unexpected event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b for instance with vm_state building and task_state spawning.
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:36:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Instance spawned successfully.
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:36:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:22 user nova-compute[75340]: INFO nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 30 09:36:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:36:22 user nova-compute[75340]: INFO nova.compute.manager [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Took 27.74 seconds to build instance.
Nov 30 09:36:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c898eedc-b821-44f8-b215-0d379f2c34bd tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.879s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:46 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:46 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:36:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:36:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:36:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:36:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:36:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:36:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:36:54 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:36:55 user nova-compute[75340]: INFO nova.compute.claims [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Claim successful on node user
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:36:55 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:36:56 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:56 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=25.202041625976562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.023s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e6828092-aa0c-48fd-866c-ac832b080938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c3814f52-db11-4fb4-b272-c5cf794511f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e0b486f0-cf2a-48ae-8d0b-6cd83316b25e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 44812720-b173-4b67-8d0c-9406254f6f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:36:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.policy [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8babf589eb4c95906e381dff4c4425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66a7e7a6ac43a1a2d2b1ba723a545c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:36:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Creating image(s)
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "/opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "/opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "/opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk 1073741824" returned: 0 in 0.049s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Successfully created port: a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.192s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Cannot resize image /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Ensure instance console log exists: /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:36:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Successfully updated port: a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquired lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-changed-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Refreshing instance network info cache due to event network-changed-a0933050-957a-494e-acfa-4d8464ea62c1. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] Acquiring lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Updating instance_info_cache with network_info: [{"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Releasing lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Instance network_info: |[{"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] Acquired lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Refreshing network info cache for port a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Start _get_guest_xml network_info=[{"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:36:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-218948989',display_name='tempest-VolumesNegativeTest-instance-218948989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-218948989',id=44,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b66a7e7a6ac43a1a2d2b1ba723a545c',ramdisk_id='',reservation_id='r-q507w0l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1687831848',owner_user_name='tempest-VolumesNegativeTest-1687831848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:36:56Z,user_data=None,user_id='8a8babf589eb4c95906e381dff4c4425',uuid=44812720-b173-4b67-8d0c-9406254f6f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converting VIF {"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lazy-loading 'pci_devices' on Instance uuid 44812720-b173-4b67-8d0c-9406254f6f50 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:36:58 user nova-compute[75340]:   <uuid>44812720-b173-4b67-8d0c-9406254f6f50</uuid>
Nov 30 09:36:58 user nova-compute[75340]:   <name>instance-0000002c</name>
Nov 30 09:36:58 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:36:58 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:36:58 user nova-compute[75340]:   <metadata>
Nov 30 09:36:58 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:36:58 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:name>tempest-VolumesNegativeTest-instance-218948989</nova:name>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:36:58</nova:creationTime>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:36:58 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:36:58 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:owner>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:user uuid="8a8babf589eb4c95906e381dff4c4425">tempest-VolumesNegativeTest-1687831848-project-member</nova:user>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:project uuid="3b66a7e7a6ac43a1a2d2b1ba723a545c">tempest-VolumesNegativeTest-1687831848</nova:project>
Nov 30 09:36:58 user nova-compute[75340]:       </nova:owner>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:36:58 user nova-compute[75340]:       <nova:ports>
Nov 30 09:36:58 user nova-compute[75340]:         <nova:port uuid="a0933050-957a-494e-acfa-4d8464ea62c1">
Nov 30 09:36:58 user nova-compute[75340]:           <nova:ip type="fixed" address="192.168.233.188" ipVersion="4"/>
Nov 30 09:36:58 user nova-compute[75340]:         </nova:port>
Nov 30 09:36:58 user nova-compute[75340]:       </nova:ports>
Nov 30 09:36:58 user nova-compute[75340]:     </nova:instance>
Nov 30 09:36:58 user nova-compute[75340]:   </metadata>
Nov 30 09:36:58 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:36:58 user nova-compute[75340]:     <system>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="serial">44812720-b173-4b67-8d0c-9406254f6f50</entry>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="uuid">44812720-b173-4b67-8d0c-9406254f6f50</entry>
Nov 30 09:36:58 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:36:58 user nova-compute[75340]:     </system>
Nov 30 09:36:58 user nova-compute[75340]:   </sysinfo>
Nov 30 09:36:58 user nova-compute[75340]:   <os>
Nov 30 09:36:58 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:36:58 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:36:58 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:36:58 user nova-compute[75340]:   </os>
Nov 30 09:36:58 user nova-compute[75340]:   <features>
Nov 30 09:36:58 user nova-compute[75340]:     <acpi/>
Nov 30 09:36:58 user nova-compute[75340]:     <apic/>
Nov 30 09:36:58 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:36:58 user nova-compute[75340]:   </features>
Nov 30 09:36:58 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:36:58 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:36:58 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:36:58 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:36:58 user nova-compute[75340]:   </clock>
Nov 30 09:36:58 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:36:58 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:36:58 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:36:58 user nova-compute[75340]:   </cpu>
Nov 30 09:36:58 user nova-compute[75340]:   <devices>
Nov 30 09:36:58 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:36:58 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:36:58 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk"/>
Nov 30 09:36:58 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:36:58 user nova-compute[75340]:     </disk>
Nov 30 09:36:58 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:36:58 user nova-compute[75340]:       <mac address="fa:16:3e:f6:0a:24"/>
Nov 30 09:36:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:36:58 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:36:58 user nova-compute[75340]:       <target dev="tapa0933050-95"/>
Nov 30 09:36:58 user nova-compute[75340]:     </interface>
Nov 30 09:36:58 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:36:58 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/console.log" append="off"/>
Nov 30 09:36:58 user nova-compute[75340]:     </serial>
Nov 30 09:36:58 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:36:58 user nova-compute[75340]:     <video>
Nov 30 09:36:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:36:58 user nova-compute[75340]:     </video>
Nov 30 09:36:58 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:36:58 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:36:58 user nova-compute[75340]:     </rng>
Nov 30 09:36:58 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:36:58 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:36:58 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:36:58 user nova-compute[75340]:     </memballoon>
Nov 30 09:36:58 user nova-compute[75340]:   </devices>
Nov 30 09:36:58 user nova-compute[75340]: </domain>
Nov 30 09:36:58 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-218948989',display_name='tempest-VolumesNegativeTest-instance-218948989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-218948989',id=44,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b66a7e7a6ac43a1a2d2b1ba723a545c',ramdisk_id='',reservation_id='r-q507w0l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1687831848',owner_user_name='tempest-VolumesNegativeTest-1687831848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:36:56Z,user_data=None,user_id='8a8babf589eb4c95906e381dff4c4425',uuid=44812720-b173-4b67-8d0c-9406254f6f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converting VIF {"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG os_vif [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8edbf886-769d-5b54-9dd3-c354330c422a', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0933050-95, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0933050-95, col_values=(('qos', UUID('d6d3c1bc-3d32-4190-8bb4-122585558617')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0933050-95, col_values=(('external_ids', {'iface-id': 'a0933050-957a-494e-acfa-4d8464ea62c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:0a:24', 'vm-uuid': '44812720-b173-4b67-8d0c-9406254f6f50'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:58 user nova-compute[75340]: INFO os_vif [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95')
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] No VIF found with MAC fa:16:3e:f6:0a:24, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Updated VIF entry in instance network info cache for port a0933050-957a-494e-acfa-4d8464ea62c1. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG nova.network.neutron [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Updating instance_info_cache with network_info: [{"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e54cc805-b73f-49ff-9fd6-cd0dae74d2c4 req-e694e3fe-8543-48d5-83c6-8440f96f425f service nova] Releasing lock "refresh_cache-44812720-b173-4b67-8d0c-9406254f6f50" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:36:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:36:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:36:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG nova.compute.manager [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] No waiting events found dispatching network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:00 user nova-compute[75340]: WARNING nova.compute.manager [req-939daafd-3591-45b7-96bb-5deddd476db1 req-0d9f8ffb-8a61-4333-8d76-82c6d8da1a81 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received unexpected event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 for instance with vm_state building and task_state spawning.
Nov 30 09:37:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:37:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Instance spawned successfully.
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.compute.manager [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] No waiting events found dispatching network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:02 user nova-compute[75340]: WARNING nova.compute.manager [req-559ac879-560c-4b29-b2c8-4cd8107d2716 req-d85fa93a-afd7-4983-8160-44e5a24c8da8 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received unexpected event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 for instance with vm_state building and task_state spawning.
Nov 30 09:37:02 user nova-compute[75340]: INFO nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 30 09:37:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:37:02 user nova-compute[75340]: INFO nova.compute.manager [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Took 6.78 seconds to build instance.
Nov 30 09:37:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1609d8ba-8e82-4255-b5ad-cf041a5ebe5b tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.899s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:28 user nova-compute[75340]: INFO nova.compute.manager [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Attaching volume a86df738-3c06-4aba-b052-51df3c5c5fe1 to /dev/vdb
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.utils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6485e-69fc-4474-9130-f44950121694]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a9c55-2b5f-44cb-818e-7f70baee4255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba2337-0870-4a8a-91cf-6a7381033402]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5711b8f-26a2-4fe9-8ff2-6629610b1897]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:37:28 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9579d2-a674-4946-89f4-f7166e979277]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG os_brick.utils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating existing volume attachment record: 9a5fc774-89b1-4b1e-be8d-27b3bd7a8271 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:28 user nova-compute[75340]: INFO nova.compute.manager [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Detaching volume 1ef9c365-cce5-4437-950d-bcf7e1ee869e
Nov 30 09:37:28 user nova-compute[75340]: INFO nova.virt.block_device [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Attempting to driver detach volume 1ef9c365-cce5-4437-950d-bcf7e1ee869e from mountpoint /dev/vdc
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Attempting to detach device vdc from instance c3814f52-db11-4fb4-b272-c5cf794511f2 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:37:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:37:28 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:37:28 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:37:28 user nova-compute[75340]:   <serial>1ef9c365-cce5-4437-950d-bcf7e1ee869e</serial>
Nov 30 09:37:28 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:37:28 user nova-compute[75340]: </disk>
Nov 30 09:37:28 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:37:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully detached device vdc from instance c3814f52-db11-4fb4-b272-c5cf794511f2 from the persistent domain config.
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c3814f52-db11-4fb4-b272-c5cf794511f2 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:37:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:37:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:37:28 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:37:28 user nova-compute[75340]:   <target dev="vdc" bus="virtio"/>
Nov 30 09:37:28 user nova-compute[75340]:   <serial>1ef9c365-cce5-4437-950d-bcf7e1ee869e</serial>
Nov 30 09:37:28 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:37:28 user nova-compute[75340]: </disk>
Nov 30 09:37:28 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:37:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:37:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:37 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[609cfd40-9437-4f07-812f-7350ac173f08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:37:37 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e20e9c7-3db7-4e90-b114-68b309cb5e38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1] added
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa28fc-dc96-4d1f-b650-f5cf5d130d11]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d040d-27ed-4d7a-b60e-234715986f6d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsOULQju {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsOULQju" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c9f0cf-b762-4e26-9f37-c573b76f63b3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsOULQju'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5968ee2-2c68-4b0c-9b10-e8784378b6c5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c303d71-674a-400c-b41a-1417d13733cc]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba18dab9-2562-409a-8d7f-deb04c9e425b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]
Nov 30 09:37:37 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd6fc6-f23e-4b4f-b265-cf0a143633db]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec72e9a-c482-49f2-a26d-db9ede5fef86]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd74a8b-e944-4353-9f16-8cd34f14d88a]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:37:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23366316665326230', 'path': '/dev/sdd'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316665326230', 'path': '/dev/sdd'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:37:38 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:37:38 user nova-compute[75340]:   <source dev="/dev/sdd"/>
Nov 30 09:37:38 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:37:38 user nova-compute[75340]:   <serial>a86df738-3c06-4aba-b052-51df3c5c5fe1</serial>
Nov 30 09:37:38 user nova-compute[75340]: </disk>
Nov 30 09:37:38 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:37:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:37:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:37:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No VIF found with MAC fa:16:3e:53:ec:44, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:37:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2b8c2cf2-fe6d-4e82-9180-46a51772b17f tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.048s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:45 user nova-compute[75340]: INFO nova.compute.manager [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Terminating instance
Nov 30 09:37:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-unplugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] No waiting events found dispatching network-vif-unplugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-3e6ef3df-4743-44fb-b8ad-7f92b53be572 req-3fba3afc-6a87-43fd-86e3-0e6141491205 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-unplugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Instance destroyed successfully.
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid e0b486f0-cf2a-48ae-8d0b-6cd83316b25e {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116933392',display_name='tempest-TestVolumeBootPattern-server-1116933392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116933392',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-447c7r7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:36:23Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=e0b486f0-cf2a-48ae-8d0b-6cd83316b25e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "address": "fa:16:3e:27:89:15", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce0298f-56", "ovs_interfaceid": "3ce0298f-56d3-4b6d-9a0c-97cc0fba832b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_vif [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce0298f-56, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9bc0651-5143-4052-881e-b3c875a1a30c) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:46 user nova-compute[75340]: INFO os_vif [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:89:15,bridge_name='br-int',has_traffic_filtering=True,id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce0298f-56')
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhWDXIbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b005ee2d-3067-4b2b-9ad9-e182a4494998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:37:46 user nova-compute[75340]: No targets found.
Nov 30 09:37:46 user nova-compute[75340]: iSNS:
Nov 30 09:37:46 user nova-compute[75340]: No targets found.
Nov 30 09:37:46 user nova-compute[75340]: STATIC:
Nov 30 09:37:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2
Nov 30 09:37:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e
Nov 30 09:37:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1
Nov 30 09:37:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:46 user nova-compute[75340]: FIRMWARE:
Nov 30 09:37:46 user nova-compute[75340]: No targets found.
Nov 30 09:37:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:37:46 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:37:46 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c3b77-bf97-4295-842c-0173d4733838]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[475f9c69-7abf-4d11-aa1d-0b6ace0b42ac]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:46 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:46 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:46 user nova-compute[75340]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 (non-flash)
Nov 30 09:37:46 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5044c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe97418b-d5c3-4f2a-abef-4abd8763317e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f59e8-ba54-4aae-b943-d6b871b2e862]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d77893-a6a6-4008-91a9-641ae465f868]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f9cef-890e-4ca2-913f-30422584c85f]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637313634613939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9cb833a', '/dev/disk/by-id/scsi-1SCST_BIOf9cb833a-f7164a99da0ce6c3') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee69c1f5-b039-4797-86de-900a25cbf573]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c46b31-272d-4c41-b961-d756dfc7722d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e4134-1410-4db7-8d04-5c38937685b5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260]
Nov 30 09:37:46 user nova-compute[75340]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2, portal: 172.16.0.220,3260] successful.
Nov 30 09:37:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e81371-e322-4717-95c5-90aac3b751d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b837a-0b26-41a7-bcce-0d4cdaf55b4c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (342ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:37:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Deleting instance files /opt/stack/data/nova/instances/e0b486f0-cf2a-48ae-8d0b-6cd83316b25e_del
Nov 30 09:37:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Deletion of /opt/stack/data/nova/instances/e0b486f0-cf2a-48ae-8d0b-6cd83316b25e_del complete
Nov 30 09:37:46 user nova-compute[75340]: INFO nova.compute.manager [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 30 09:37:46 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:37:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing instance network info cache due to event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated VIF entry in instance network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d533f6f1-1d51-4ac5-bbd9-661a66cda25c req-5e40f393-6945-455a-a4eb-0249f72d53b1 service nova] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:48 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Took 1.06 seconds to deallocate network for instance.
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-82153f96-94e1-4c5d-94e6-184c92271329 req-f3237e7a-3caa-48f6-ae97-d0b2afe0bb45 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-deleted-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:48 user nova-compute[75340]: INFO nova.compute.manager [req-82153f96-94e1-4c5d-94e6-184c92271329 req-f3237e7a-3caa-48f6-ae97-d0b2afe0bb45 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Neutron deleted interface 3ce0298f-56d3-4b6d-9a0c-97cc0fba832b; detaching it from the instance and deleting it from the info cache
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-82153f96-94e1-4c5d-94e6-184c92271329 req-f3237e7a-3caa-48f6-ae97-d0b2afe0bb45 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-82153f96-94e1-4c5d-94e6-184c92271329 req-f3237e7a-3caa-48f6-ae97-d0b2afe0bb45 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Detach interface failed, port_id=3ce0298f-56d3-4b6d-9a0c-97cc0fba832b, reason: Instance e0b486f0-cf2a-48ae-8d0b-6cd83316b25e could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] Acquiring lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] No waiting events found dispatching network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:48 user nova-compute[75340]: WARNING nova.compute.manager [req-f2fd26d3-e95b-4616-aea9-4b8660840c8f req-8e0299fc-b7e6-445a-a7c3-be88391d3c36 service nova] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Received unexpected event network-vif-plugged-3ce0298f-56d3-4b6d-9a0c-97cc0fba832b for instance with vm_state active and task_state deleting.
Nov 30 09:37:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:37:48 user nova-compute[75340]: INFO nova.compute.manager [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 09:37:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: e0b486f0-cf2a-48ae-8d0b-6cd83316b25e] Deleting volume: 47e81371-e322-4717-95c5-90aac3b751d2 {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:49 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance e0b486f0-cf2a-48ae-8d0b-6cd83316b25e
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ae406565-51c9-49d2-9678-314c94dff72e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "e0b486f0-cf2a-48ae-8d0b-6cd83316b25e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.618s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:49 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c3814f52-db11-4fb4-b272-c5cf794511f2 is timed out.
Nov 30 09:37:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully detached device vdc from instance c3814f52-db11-4fb4-b272-c5cf794511f2 from the live domain config.
Nov 30 09:37:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkruRbLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:49 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9340364a-9f95-4e8d-a278-506a6a641c62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:37:49 user nova-compute[75340]: No targets found.
Nov 30 09:37:49 user nova-compute[75340]: iSNS:
Nov 30 09:37:49 user nova-compute[75340]: No targets found.
Nov 30 09:37:49 user nova-compute[75340]: STATIC:
Nov 30 09:37:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e
Nov 30 09:37:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:49 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1
Nov 30 09:37:49 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:49 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:49 user nova-compute[75340]: FIRMWARE:
Nov 30 09:37:49 user nova-compute[75340]: No targets found.
Nov 30 09:37:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:37:49 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:37:49 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b53cd85-c6c9-4ef9-b9b1-6365d1346dff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba0dd8e-bbd8-43a4-bbdc-5dbe285082e5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:49 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e (non-flash)
Nov 30 09:37:49 user nova-compute[75340]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305a3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b20b1-33d4-458c-8b09-7dc60b383561]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb8f2a-63d7-47ac-b7de-af9583722f04]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[719831d2-e67b-4dd7-9c23-def39b01d69c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb1ba5b-d187-4dcb-a2f4-02668e271cb7]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ed5a1-cb4d-4662-bc54-20fb72cf1be3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a86774-18f8-4d4b-b036-4fa0bbc6b248]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260]
Nov 30 09:37:49 user nova-compute[75340]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e, portal: 172.16.0.220,3260] successful.
Nov 30 09:37:49 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef9c365-cce5-4437-950d-bcf7e1ee869e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6f2c6-3170-4a88-9fca-fb260fe8d9b6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] <== disconnect_volume: return (321ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:37:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.compute.manager [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing instance network info cache due to event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated VIF entry in instance network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e8e6a98b-c7f5-4536-98b9-e872226d39c0 req-e037b042-f162-444d-a709-52a11c2eb8f6 service nova] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'flavor' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6767fccc-858d-4036-a97b-62e5b52da191 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:37:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:37:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:37:52 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:37:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [{"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-c3814f52-db11-4fb4-b272-c5cf794511f2" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:37:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:37:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:55 user nova-compute[75340]: INFO nova.compute.manager [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Rebooting instance
Nov 30 09:37:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:56 user nova-compute[75340]: WARNING nova.compute.manager [req-e2b84440-dcd0-4f3a-a224-4edcb6795a30 req-c26fad04-e047-477a-b8c7-b4d267f5809d service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:37:56 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance destroyed successfully.
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.objects.instance [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'resources' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:37:56Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2929a82b-85, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef7f8c87-a11a-4d64-bb8f-6378d3f341ce) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:56 user nova-compute[75340]: INFO os_vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85')
Nov 30 09:37:56 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:56 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a5971-b0c5-4334-916d-b582f224d040]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:37:56 user nova-compute[75340]: No targets found.
Nov 30 09:37:56 user nova-compute[75340]: iSNS:
Nov 30 09:37:56 user nova-compute[75340]: No targets found.
Nov 30 09:37:56 user nova-compute[75340]: STATIC:
Nov 30 09:37:56 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1
Nov 30 09:37:56 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:37:56 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:37:56 user nova-compute[75340]: FIRMWARE:
Nov 30 09:37:56 user nova-compute[75340]: No targets found.
Nov 30 09:37:56 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:37:56 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:37:56 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:56 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a63b672-e29a-4cc2-9ec0-7baeca1851d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c4ae2-cc3c-498c-801d-d9fbbc41e077]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff502bf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1'): ({'sdd'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Removing single pathed devices sdd {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f13c4-d63e-46ca-9a1e-3547d22f878a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[69413f31-99e8-43df-8b4c-8d1ebfc1a147]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flushing IO for device /dev/sdd {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e22f6-cc97-4545-b9d7-dc3feb67acde]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374bf82-7ed0-4dfa-bfe7-340cc083f363]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] SCSI volumes sdd have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a36378-f990-4284-b570-00b438f7d98c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9ae2b-8b99-466e-8f5c-d70e9bd15442]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]
Nov 30 09:37:57 user nova-compute[75340]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2649ffaa-b2d9-4067-8eae-ddd3ed4dc49d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== disconnect_volume: return (362ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start _get_guest_xml network_info=[{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=85cd8986-7951-4a52-a0f5-e27a7d393f72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '85cd8986-7951-4a52-a0f5-e27a7d393f72'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '9a5fc774-89b1-4b1e-be8d-27b3bd7a8271', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e6828092-aa0c-48fd-866c-ac832b080938', 'attached_at': '', 'detached_at': '', 'volume_id': 'a86df738-3c06-4aba-b052-51df3c5c5fe1', 'serial': 'a86df738-3c06-4aba-b052-51df3c5c5fe1'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:37:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:37:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=85cd8986-7951-4a52-a0f5-e27a7d393f72,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.objects.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Object Instance<e6828092-aa0c-48fd-866c-ac832b080938> lazy-loaded attributes: resources,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:37:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:37:57 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3192f-9bd8-4d5a-a03e-6559da458fef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:37:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d179d7d-9737-41e3-b455-b21d0bf91022]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1] added
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2576f95-62b6-47ca-a867-2b627059b8ef]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b6af5-4d82-46c2-8016-5a1c4897c851]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsOULQju {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsOULQju" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cff7b8-709f-45fd-a9b1-a1e46ffdeaf6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsOULQju'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ded220-93c5-4ed5-aa23-745d6b4c2a53]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b7373-ee9a-44bd-adea-3da55ccd6796]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:37:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:37:57 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:37:57 user nova-compute[75340]: 
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a17b05-6e20-4d4b-9a6c-034d04fe209d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]
Nov 30 09:37:57 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e8984b-4fd1-447c-b708-3fe7fe26be0c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[173dfc26-3416-48b2-af85-542b55174127]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:37:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e33903-cb7d-43a9-927c-006cd13097de]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:37:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Error from libvirt while getting description of instance-0000002a: [Error Code 42] Domain not found: no domain with matching uuid 'e6828092-aa0c-48fd-866c-ac832b080938' (instance-0000002a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e6828092-aa0c-48fd-866c-ac832b080938' (instance-0000002a)
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.manager [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:37:58 user nova-compute[75340]: WARNING nova.compute.manager [req-ba340542-276a-45b8-925c-02b3afaa2218 req-52aab39c-b9f2-4ce1-b899-ddce88427ed0 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 09:37:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:37:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.16223907470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e6828092-aa0c-48fd-866c-ac832b080938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c3814f52-db11-4fb4-b272-c5cf794511f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 44812720-b173-4b67-8d0c-9406254f6f50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23366316665326230', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316665326230', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:37:56Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.objects.instance [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'pci_devices' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.objects.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Object Instance<e6828092-aa0c-48fd-866c-ac832b080938> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:37:58 user nova-compute[75340]:   <uuid>e6828092-aa0c-48fd-866c-ac832b080938</uuid>
Nov 30 09:37:58 user nova-compute[75340]:   <name>instance-0000002a</name>
Nov 30 09:37:58 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:37:58 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:37:58 user nova-compute[75340]:   <metadata>
Nov 30 09:37:58 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:37:58 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:name>tempest-TestMinimumBasicScenario-server-87139045</nova:name>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:37:57</nova:creationTime>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:37:58 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:37:58 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:owner>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:user uuid="0bbb4a25e58849c89e71d22727b082b7">tempest-TestMinimumBasicScenario-627001043-project-member</nova:user>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:project uuid="59c44e90da98479fb459142c4acb01ea">tempest-TestMinimumBasicScenario-627001043</nova:project>
Nov 30 09:37:58 user nova-compute[75340]:       </nova:owner>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:root type="image" uuid="85cd8986-7951-4a52-a0f5-e27a7d393f72"/>
Nov 30 09:37:58 user nova-compute[75340]:       <nova:ports>
Nov 30 09:37:58 user nova-compute[75340]:         <nova:port uuid="2929a82b-85c5-4f89-bfa5-15df6cb1cb7d">
Nov 30 09:37:58 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 09:37:58 user nova-compute[75340]:         </nova:port>
Nov 30 09:37:58 user nova-compute[75340]:       </nova:ports>
Nov 30 09:37:58 user nova-compute[75340]:     </nova:instance>
Nov 30 09:37:58 user nova-compute[75340]:   </metadata>
Nov 30 09:37:58 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:37:58 user nova-compute[75340]:     <system>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="serial">e6828092-aa0c-48fd-866c-ac832b080938</entry>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="uuid">e6828092-aa0c-48fd-866c-ac832b080938</entry>
Nov 30 09:37:58 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:37:58 user nova-compute[75340]:     </system>
Nov 30 09:37:58 user nova-compute[75340]:   </sysinfo>
Nov 30 09:37:58 user nova-compute[75340]:   <os>
Nov 30 09:37:58 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:37:58 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:37:58 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:37:58 user nova-compute[75340]:   </os>
Nov 30 09:37:58 user nova-compute[75340]:   <features>
Nov 30 09:37:58 user nova-compute[75340]:     <acpi/>
Nov 30 09:37:58 user nova-compute[75340]:     <apic/>
Nov 30 09:37:58 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:37:58 user nova-compute[75340]:   </features>
Nov 30 09:37:58 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:37:58 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:37:58 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:37:58 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:37:58 user nova-compute[75340]:   </clock>
Nov 30 09:37:58 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:37:58 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:37:58 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:37:58 user nova-compute[75340]:   </cpu>
Nov 30 09:37:58 user nova-compute[75340]:   <devices>
Nov 30 09:37:58 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:37:58 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:37:58 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk"/>
Nov 30 09:37:58 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:37:58 user nova-compute[75340]:     </disk>
Nov 30 09:37:58 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:37:58 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:37:58 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:37:58 user nova-compute[75340]:       <target dev="vdb" bus="virtio"/>
Nov 30 09:37:58 user nova-compute[75340]:       <serial>a86df738-3c06-4aba-b052-51df3c5c5fe1</serial>
Nov 30 09:37:58 user nova-compute[75340]:     </disk>
Nov 30 09:37:58 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:37:58 user nova-compute[75340]:       <mac address="fa:16:3e:53:ec:44"/>
Nov 30 09:37:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:37:58 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:37:58 user nova-compute[75340]:       <target dev="tap2929a82b-85"/>
Nov 30 09:37:58 user nova-compute[75340]:     </interface>
Nov 30 09:37:58 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:37:58 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/console.log" append="off"/>
Nov 30 09:37:58 user nova-compute[75340]:     </serial>
Nov 30 09:37:58 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:37:58 user nova-compute[75340]:     <video>
Nov 30 09:37:58 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:37:58 user nova-compute[75340]:     </video>
Nov 30 09:37:58 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:37:58 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:37:58 user nova-compute[75340]:     </rng>
Nov 30 09:37:58 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:37:58 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:37:58 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:37:58 user nova-compute[75340]:     </memballoon>
Nov 30 09:37:58 user nova-compute[75340]:   </devices>
Nov 30 09:37:58 user nova-compute[75340]: </domain>
Nov 30 09:37:58 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.objects.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Object Instance<e6828092-aa0c-48fd-866c-ac832b080938> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Cannot resize image /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'migration_context' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.objects.base [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Object Instance<e6828092-aa0c-48fd-866c-ac832b080938> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:37:56Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG os_vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6af152b-4f49-51d7-a03e-479bc7bd9fe9', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2929a82b-85, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2929a82b-85, col_values=(('qos', UUID('e127b9a1-5086-4234-baf1-0883386b46fc')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2929a82b-85, col_values=(('external_ids', {'iface-id': '2929a82b-85c5-4f89-bfa5-15df6cb1cb7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ec:44', 'vm-uuid': 'e6828092-aa0c-48fd-866c-ac832b080938'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:37:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:37:59 user nova-compute[75340]: INFO os_vif [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85')
Nov 30 09:38:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:01 user nova-compute[75340]: WARNING nova.compute.manager [req-12153836-527f-4bec-a0eb-ff705484fe01 req-48707c2f-6169-496d-92d1-fd0a87b8c232 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 09:38:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:38:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance rebooted successfully.
Nov 30 09:38:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:03 user nova-compute[75340]: WARNING nova.compute.manager [req-bbde4498-c4ea-4bd0-87a8-612955c48c5c req-8fa861f0-3916-4f19-9d19-dab7b13ec4de service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 09:38:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-08250db2-a63f-45d8-815b-4a6064421de6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.946s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:38:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:19 user nova-compute[75340]: INFO nova.compute.manager [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Terminating instance
Nov 30 09:38:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-9afe18c5-d794-434d-8a7b-29a34559c149 req-c06980d8-5f5b-4003-a1ed-7dee9af71b57 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-unplugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:38:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Instance destroyed successfully.
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'resources' on Instance uuid c3814f52-db11-4fb4-b272-c5cf794511f2 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1975615668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1975615668',id=40,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPAuePxfVK9KzfjPCWK5pwa924BGsv9d0OXvzlR5J/iQjHOCHafLlE0ynMfVMhm0AamVDyJ7pS73pxeQ0DQok4lzTIo8Chv/rcVlWP5i7BHAbB7/+pcGT1QgmgAl2kvjQ==',key_name='tempest-keypair-264695344',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-sg7t8vbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=c3814f52-db11-4fb4-b272-c5cf794511f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "address": "fa:16:3e:96:a7:c0", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9cdba3-35", "ovs_interfaceid": "bc9cdba3-3512-49eb-9fdc-29711f03c709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG os_vif [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9cdba3-35, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04f0060d-e974-4d8d-b7dc-29728c3f69fc) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:20 user nova-compute[75340]: INFO os_vif [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=bc9cdba3-3512-49eb-9fdc-29711f03c709,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9cdba3-35')
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Deleting instance files /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2_del
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Deletion of /opt/stack/data/nova/instances/c3814f52-db11-4fb4-b272-c5cf794511f2_del complete
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.compute.manager [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 09:38:20 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Took 0.74 seconds to deallocate network for instance.
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-3660dc0b-0970-4dad-9df4-f00043169790 req-e0dcef51-8298-469d-8975-926dfdfa9566 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-deleted-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:20 user nova-compute[75340]: INFO nova.compute.manager [req-3660dc0b-0970-4dad-9df4-f00043169790 req-e0dcef51-8298-469d-8975-926dfdfa9566 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Neutron deleted interface bc9cdba3-3512-49eb-9fdc-29711f03c709; detaching it from the instance and deleting it from the info cache
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.network.neutron [req-3660dc0b-0970-4dad-9df4-f00043169790 req-e0dcef51-8298-469d-8975-926dfdfa9566 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG nova.compute.manager [req-3660dc0b-0970-4dad-9df4-f00043169790 req-e0dcef51-8298-469d-8975-926dfdfa9566 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Detach interface failed, port_id=bc9cdba3-3512-49eb-9fdc-29711f03c709, reason: Instance c3814f52-db11-4fb4-b272-c5cf794511f2 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:21 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Deleted allocations for instance c3814f52-db11-4fb4-b272-c5cf794511f2
Nov 30 09:38:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e74d6629-54ea-437d-83c5-8f916d981ad5 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] Acquiring lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] Lock "c3814f52-db11-4fb4-b272-c5cf794511f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] No waiting events found dispatching network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:21 user nova-compute[75340]: WARNING nova.compute.manager [req-206157b0-0b7b-48bc-a557-ed04640413f1 req-a96f5f23-b859-4222-b1b7-abbeaf87f111 service nova] [instance: c3814f52-db11-4fb4-b272-c5cf794511f2] Received unexpected event network-vif-plugged-bc9cdba3-3512-49eb-9fdc-29711f03c709 for instance with vm_state deleted and task_state None.
Nov 30 09:38:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:45 user nova-compute[75340]: INFO nova.compute.manager [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Terminating instance
Nov 30 09:38:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-unplugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] No waiting events found dispatching network-vif-unplugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-95e38b52-c454-4c8a-b6b4-27ef61378ef5 req-5f22cebc-5d0f-452f-99ba-da9261ee5d29 service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-unplugged-a0933050-957a-494e-acfa-4d8464ea62c1 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:38:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Instance destroyed successfully.
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lazy-loading 'resources' on Instance uuid 44812720-b173-4b67-8d0c-9406254f6f50 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-218948989',display_name='tempest-VolumesNegativeTest-instance-218948989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-218948989',id=44,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b66a7e7a6ac43a1a2d2b1ba723a545c',ramdisk_id='',reservation_id='r-q507w0l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1687831848',owner_user_name='tempest-VolumesNegativeTest-1687831848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:37:02Z,user_data=None,user_id='8a8babf589eb4c95906e381dff4c4425',uuid=44812720-b173-4b67-8d0c-9406254f6f50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converting VIF {"id": "a0933050-957a-494e-acfa-4d8464ea62c1", "address": "fa:16:3e:f6:0a:24", "network": {"id": "b4192ba6-17ec-4e45-bded-893ea6ca21c7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cc8213d4ad7945f4a5f1789dd0bbb526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0933050-95", "ovs_interfaceid": "a0933050-957a-494e-acfa-4d8464ea62c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG os_vif [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0933050-95, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6d3c1bc-3d32-4190-8bb4-122585558617) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:38:46 user nova-compute[75340]: INFO os_vif [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:24,bridge_name='br-int',has_traffic_filtering=True,id=a0933050-957a-494e-acfa-4d8464ea62c1,network=Network(b4192ba6-17ec-4e45-bded-893ea6ca21c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0933050-95')
Nov 30 09:38:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Deleting instance files /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50_del
Nov 30 09:38:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Deletion of /opt/stack/data/nova/instances/44812720-b173-4b67-8d0c-9406254f6f50_del complete
Nov 30 09:38:46 user nova-compute[75340]: INFO nova.compute.manager [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 09:38:46 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:38:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:47 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Took 0.50 seconds to deallocate network for instance.
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:47 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Deleted allocations for instance 44812720-b173-4b67-8d0c-9406254f6f50
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-6019a90f-6fbd-489a-bb53-0835d5d2379f tempest-VolumesNegativeTest-1687831848 tempest-VolumesNegativeTest-1687831848-project-member] Lock "44812720-b173-4b67-8d0c-9406254f6f50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] Acquiring lock "44812720-b173-4b67-8d0c-9406254f6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] Lock "44812720-b173-4b67-8d0c-9406254f6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] No waiting events found dispatching network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:38:47 user nova-compute[75340]: WARNING nova.compute.manager [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received unexpected event network-vif-plugged-a0933050-957a-494e-acfa-4d8464ea62c1 for instance with vm_state deleted and task_state None.
Nov 30 09:38:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-09df0021-c8d0-4b36-853c-b711f87d9b02 req-2d547ff8-4019-4554-a8ca-212f365ac6bc service nova] [instance: 44812720-b173-4b67-8d0c-9406254f6f50] Received event network-vif-deleted-a0933050-957a-494e-acfa-4d8464ea62c1 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:38:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:38:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:38:54 user nova-compute[75340]: INFO nova.compute.claims [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Claim successful on node user
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:38:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:38:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:38:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG nova.policy [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:38:55 user nova-compute[75340]: INFO nova.virt.block_device [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Booting with volume 312258d4-81d5-40ce-94a8-21ab47f172bd at /dev/vda
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.utils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a8bfd-2d54-4ad1-97e3-0d021ab40a2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb7188-b3bd-4b0f-9a67-b8e56a560535]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[66431095-4d9b-4f73-90e8-e78c87e36404]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[da383a40-0434-4e23-81a3-07882a30ce50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:38:55 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5c337-7a2e-4b7e-aedc-d95ce71662e7]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG os_brick.utils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating existing volume attachment record: 4fa24f5f-a1ad-4261-a37f-045289fbe2a4 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Successfully created port: 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:38:55 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Successfully updated port: 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-changed-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.compute.manager [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Refreshing instance network info cache due to event network-changed-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] Acquiring lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Instance network_info: |[{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] Acquired lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Refreshing network info cache for port 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:38:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updated VIF entry in instance network info cache for port 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.network.neutron [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-21dd5ec4-89ba-4438-9cb5-477d2e123e51 req-2bce62f9-29b6-4b51-b080-e0a569b43f3c service nova] Releasing lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:38:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:38:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.213851928710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e6828092-aa0c-48fd-866c-ac832b080938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c0028250-40b7-45e4-afc3-8928a910450d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:38:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:38:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:39:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Creating image(s)
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Ensure instance console log exists: /opt/stack/data/nova/instances/c0028250-40b7-45e4-afc3-8928a910450d/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Start _get_guest_xml network_info=[{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '4fa24f5f-a1ad-4261-a37f-045289fbe2a4', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBnQApNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0028250-40b7-45e4-afc3-8928a910450d', 'attached_at': '', 'detached_at': '', 'volume_id': '312258d4-81d5-40ce-94a8-21ab47f172bd', 'serial': '312258d4-81d5-40ce-94a8-21ab47f172bd'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:39:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBnQApNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:39:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:39:04 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:39:04 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123d248-dfe6-4908-a866-3cce5ffe7ac3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:39:04 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a50a14-8a1b-46a0-a0e1-4f8149b146c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd] added
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da39e8-f2ed-4b5c-a220-46d2b1944323]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[87585bc1-5612-4205-af8c-331b17c1b928]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBnQApNx {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBnQApNx" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1c2e9-5c30-43d4-bf87-b6960aa9c67c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wBnQApNx'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39d7af2-dabb-470c-93b1-0cd46cc4f7dc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6966fc3-fb98-44ba-800a-b4feeb30afe9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7ac25-df04-46c0-a685-73fab6e6ff41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260]
Nov 30 09:39:04 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260] successful.
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa8f7c9-3898-4a37-8672-599fdb5234c2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d68c67-8646-42c3-b6c2-4fbbca70f164]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:39:04 user nova-compute[75340]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:39:04 user nova-compute[75340]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:39:04 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[01347a4e-b8da-4fd9-8715-5de4f7adec71]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:39:04 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBnQApNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23439383939306131', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439383939306131', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-790879160',display_name='tempest-TestVolumeBootPattern-volume-backed-server-790879160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-790879160',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE344b+KBUmIYPBQRVgoRATunmkXVNk5LcUkVbQ3RHxQNcEGJLluJHzp4Y9XY785oQRyl4qMgAiA2KrCMsvoGmZKJZFaEC4icOu9zYMi6WIRaOy9+IAFo4D+yOY9QaBp5A==',key_name='tempest-keypair-922701451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-pexo88of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=c0028250-40b7-45e4-afc3-8928a910450d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.objects.instance [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid c0028250-40b7-45e4-afc3-8928a910450d {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:39:05 user nova-compute[75340]:   <uuid>c0028250-40b7-45e4-afc3-8928a910450d</uuid>
Nov 30 09:39:05 user nova-compute[75340]:   <name>instance-0000002d</name>
Nov 30 09:39:05 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:39:05 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:39:05 user nova-compute[75340]:   <metadata>
Nov 30 09:39:05 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:39:05 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:39:05 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-790879160</nova:name>
Nov 30 09:39:05 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:39:04</nova:creationTime>
Nov 30 09:39:05 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:39:05 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:39:05 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:39:05 user nova-compute[75340]:       <nova:owner>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:39:05 user nova-compute[75340]:       </nova:owner>
Nov 30 09:39:05 user nova-compute[75340]:       <nova:ports>
Nov 30 09:39:05 user nova-compute[75340]:         <nova:port uuid="1aa1f27d-b3d3-4a3d-b5cd-97a40158808c">
Nov 30 09:39:05 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 09:39:05 user nova-compute[75340]:         </nova:port>
Nov 30 09:39:05 user nova-compute[75340]:       </nova:ports>
Nov 30 09:39:05 user nova-compute[75340]:     </nova:instance>
Nov 30 09:39:05 user nova-compute[75340]:   </metadata>
Nov 30 09:39:05 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:39:05 user nova-compute[75340]:     <system>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="serial">c0028250-40b7-45e4-afc3-8928a910450d</entry>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="uuid">c0028250-40b7-45e4-afc3-8928a910450d</entry>
Nov 30 09:39:05 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:39:05 user nova-compute[75340]:     </system>
Nov 30 09:39:05 user nova-compute[75340]:   </sysinfo>
Nov 30 09:39:05 user nova-compute[75340]:   <os>
Nov 30 09:39:05 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:39:05 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:39:05 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:39:05 user nova-compute[75340]:   </os>
Nov 30 09:39:05 user nova-compute[75340]:   <features>
Nov 30 09:39:05 user nova-compute[75340]:     <acpi/>
Nov 30 09:39:05 user nova-compute[75340]:     <apic/>
Nov 30 09:39:05 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:39:05 user nova-compute[75340]:   </features>
Nov 30 09:39:05 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:39:05 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:39:05 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:39:05 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:39:05 user nova-compute[75340]:   </clock>
Nov 30 09:39:05 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:39:05 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:39:05 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:39:05 user nova-compute[75340]:   </cpu>
Nov 30 09:39:05 user nova-compute[75340]:   <devices>
Nov 30 09:39:05 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:39:05 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:39:05 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:39:05 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:39:05 user nova-compute[75340]:       <serial>312258d4-81d5-40ce-94a8-21ab47f172bd</serial>
Nov 30 09:39:05 user nova-compute[75340]:     </disk>
Nov 30 09:39:05 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:39:05 user nova-compute[75340]:       <mac address="fa:16:3e:10:0a:92"/>
Nov 30 09:39:05 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:39:05 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:39:05 user nova-compute[75340]:       <target dev="tap1aa1f27d-b3"/>
Nov 30 09:39:05 user nova-compute[75340]:     </interface>
Nov 30 09:39:05 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:39:05 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/c0028250-40b7-45e4-afc3-8928a910450d/console.log" append="off"/>
Nov 30 09:39:05 user nova-compute[75340]:     </serial>
Nov 30 09:39:05 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:39:05 user nova-compute[75340]:     <video>
Nov 30 09:39:05 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:39:05 user nova-compute[75340]:     </video>
Nov 30 09:39:05 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:39:05 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:39:05 user nova-compute[75340]:     </rng>
Nov 30 09:39:05 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:39:05 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:39:05 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:39:05 user nova-compute[75340]:     </memballoon>
Nov 30 09:39:05 user nova-compute[75340]:   </devices>
Nov 30 09:39:05 user nova-compute[75340]: </domain>
Nov 30 09:39:05 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-790879160',display_name='tempest-TestVolumeBootPattern-volume-backed-server-790879160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-790879160',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE344b+KBUmIYPBQRVgoRATunmkXVNk5LcUkVbQ3RHxQNcEGJLluJHzp4Y9XY785oQRyl4qMgAiA2KrCMsvoGmZKJZFaEC4icOu9zYMi6WIRaOy9+IAFo4D+yOY9QaBp5A==',key_name='tempest-keypair-922701451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-pexo88of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=c0028250-40b7-45e4-afc3-8928a910450d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG os_vif [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f261ab-5eee-55ed-90e3-16a92f9632cf', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aa1f27d-b3, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aa1f27d-b3, col_values=(('qos', UUID('2c55364d-84cb-498e-8b32-0e3e635ae13e')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aa1f27d-b3, col_values=(('external_ids', {'iface-id': '1aa1f27d-b3d3-4a3d-b5cd-97a40158808c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:0a:92', 'vm-uuid': 'c0028250-40b7-45e4-afc3-8928a910450d'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:39:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:06 user nova-compute[75340]: INFO os_vif [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3')
Nov 30 09:39:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:39:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:10:0a:92, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] No waiting events found dispatching network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:39:07 user nova-compute[75340]: WARNING nova.compute.manager [req-3cbdffd7-3b31-498b-ac08-308eb65d06f8 req-cbb5d79b-e965-42a6-a36c-9c7239e74392 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received unexpected event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c for instance with vm_state building and task_state spawning.
Nov 30 09:39:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:39:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Instance spawned successfully.
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:09 user nova-compute[75340]: INFO nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:39:09 user nova-compute[75340]: INFO nova.compute.manager [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Took 14.88 seconds to build instance.
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] No waiting events found dispatching network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:39:09 user nova-compute[75340]: WARNING nova.compute.manager [req-c18ff585-0ed2-4216-b3a8-c5f9c3501ddd req-23c646d0-509a-4850-b7e7-bf0e70c3a543 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received unexpected event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c for instance with vm_state active and task_state None.
Nov 30 09:39:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-0f773a9c-148a-4921-8fb5-249e76a8860e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.044s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:39:13 user nova-compute[75340]: INFO nova.compute.claims [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Claim successful on node user
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:39:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.policy [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34a31aeeca154620ba74acbaaabcdced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a6d95b1ed43879eca5e07be0a4276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:39:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Creating image(s)
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.223s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk 1073741824" returned: 0 in 0.051s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Successfully created port: fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Cannot resize image /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Ensure instance console log exists: /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Successfully updated port: fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.compute.manager [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing instance network info cache due to event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance network_info: |[{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start _get_guest_xml network_info=[{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:39:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:15 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfwaxpEdJsXFYVE88eGrMcxXL4BBgXD9zvHpieOvq+ilGAnCGqBSACDoJcVUx7IHE6wM5nwv3GbOCPESGF9Sxi4Fm1QwmopCGWl623NczwROHfH8EjkHAOoTyvMVTF3ZQ==',key_name='tempest-keypair-1121072342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.objects.instance [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_devices' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:39:15 user nova-compute[75340]:   <uuid>a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</uuid>
Nov 30 09:39:15 user nova-compute[75340]:   <name>instance-0000002e</name>
Nov 30 09:39:15 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:39:15 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:39:15 user nova-compute[75340]:   <metadata>
Nov 30 09:39:15 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:39:15 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-461451209</nova:name>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:39:15</nova:creationTime>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:39:15 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:39:15 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:owner>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:user uuid="34a31aeeca154620ba74acbaaabcdced">tempest-AttachVolumeShelveTestJSON-1052742553-project-member</nova:user>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:project uuid="a90a6d95b1ed43879eca5e07be0a4276">tempest-AttachVolumeShelveTestJSON-1052742553</nova:project>
Nov 30 09:39:15 user nova-compute[75340]:       </nova:owner>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:39:15 user nova-compute[75340]:       <nova:ports>
Nov 30 09:39:15 user nova-compute[75340]:         <nova:port uuid="fdbd9421-e567-4b3a-bd7b-442868a99815">
Nov 30 09:39:15 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 09:39:15 user nova-compute[75340]:         </nova:port>
Nov 30 09:39:15 user nova-compute[75340]:       </nova:ports>
Nov 30 09:39:15 user nova-compute[75340]:     </nova:instance>
Nov 30 09:39:15 user nova-compute[75340]:   </metadata>
Nov 30 09:39:15 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:39:15 user nova-compute[75340]:     <system>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="serial">a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</entry>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="uuid">a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</entry>
Nov 30 09:39:15 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:39:15 user nova-compute[75340]:     </system>
Nov 30 09:39:15 user nova-compute[75340]:   </sysinfo>
Nov 30 09:39:15 user nova-compute[75340]:   <os>
Nov 30 09:39:15 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:39:15 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:39:15 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:39:15 user nova-compute[75340]:   </os>
Nov 30 09:39:15 user nova-compute[75340]:   <features>
Nov 30 09:39:15 user nova-compute[75340]:     <acpi/>
Nov 30 09:39:15 user nova-compute[75340]:     <apic/>
Nov 30 09:39:15 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:39:15 user nova-compute[75340]:   </features>
Nov 30 09:39:15 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:39:15 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:39:15 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:39:15 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:39:15 user nova-compute[75340]:   </clock>
Nov 30 09:39:15 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:39:15 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:39:15 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:39:15 user nova-compute[75340]:   </cpu>
Nov 30 09:39:15 user nova-compute[75340]:   <devices>
Nov 30 09:39:15 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:39:15 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:39:15 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk"/>
Nov 30 09:39:15 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:39:15 user nova-compute[75340]:     </disk>
Nov 30 09:39:15 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:39:15 user nova-compute[75340]:       <mac address="fa:16:3e:2f:9b:10"/>
Nov 30 09:39:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:39:15 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:39:15 user nova-compute[75340]:       <target dev="tapfdbd9421-e5"/>
Nov 30 09:39:15 user nova-compute[75340]:     </interface>
Nov 30 09:39:15 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:39:15 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/console.log" append="off"/>
Nov 30 09:39:15 user nova-compute[75340]:     </serial>
Nov 30 09:39:15 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:39:15 user nova-compute[75340]:     <video>
Nov 30 09:39:15 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:39:15 user nova-compute[75340]:     </video>
Nov 30 09:39:15 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:39:15 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:39:15 user nova-compute[75340]:     </rng>
Nov 30 09:39:15 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:39:15 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:39:15 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:39:15 user nova-compute[75340]:     </memballoon>
Nov 30 09:39:15 user nova-compute[75340]:   </devices>
Nov 30 09:39:15 user nova-compute[75340]: </domain>
Nov 30 09:39:15 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfwaxpEdJsXFYVE88eGrMcxXL4BBgXD9zvHpieOvq+ilGAnCGqBSACDoJcVUx7IHE6wM5nwv3GbOCPESGF9Sxi4Fm1QwmopCGWl623NczwROHfH8EjkHAOoTyvMVTF3ZQ==',key_name='tempest-keypair-1121072342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG os_vif [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c98106fc-c18c-5b65-b09a-df2c73a5a279', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdbd9421-e5, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdbd9421-e5, col_values=(('qos', UUID('6949643b-02fb-4db3-a105-c2e358ad10f2')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdbd9421-e5, col_values=(('external_ids', {'iface-id': 'fdbd9421-e567-4b3a-bd7b-442868a99815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:9b:10', 'vm-uuid': 'a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:15 user nova-compute[75340]: INFO os_vif [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5')
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No VIF found with MAC fa:16:3e:2f:9b:10, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updated VIF entry in instance network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG nova.network.neutron [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:39:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-93723bfd-4a29-4ed0-ae2b-0d107ab5641f req-6ae057b1-982a-4d47-8148-13a287995ed1 service nova] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:39:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG nova.compute.manager [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:39:17 user nova-compute[75340]: WARNING nova.compute.manager [req-4f1cb5e0-da91-4d9d-93c9-062c8e8651c5 req-655ab630-3f09-4d96-9b40-7c7f9ee29ff7 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state building and task_state spawning.
Nov 30 09:39:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:39:19 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance spawned successfully.
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:39:19 user nova-compute[75340]: INFO nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:39:19 user nova-compute[75340]: WARNING nova.compute.manager [req-7575766f-6fde-4a6d-9ef5-95f4f977e0ad req-7fe60d65-a1eb-481b-8afe-cf9fd7321462 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state building and task_state spawning.
Nov 30 09:39:19 user nova-compute[75340]: INFO nova.compute.manager [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Took 6.10 seconds to build instance.
Nov 30 09:39:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-55d8dbe9-408e-45f8-bf86-5762f182ed80 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.196s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing instance network info cache due to event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:39:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:39:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:39:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated VIF entry in instance network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-dc8f3544-ca64-424e-9f73-70b8f3954ea7 req-70057f12-06f1-4f82-9993-f5e52aacd47a service nova] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:48 user nova-compute[75340]: INFO nova.compute.manager [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Detaching volume a86df738-3c06-4aba-b052-51df3c5c5fe1
Nov 30 09:39:48 user nova-compute[75340]: INFO nova.virt.block_device [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Attempting to driver detach volume a86df738-3c06-4aba-b052-51df3c5c5fe1 from mountpoint /dev/vdb
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Attempting to detach device vdb from instance e6828092-aa0c-48fd-866c-ac832b080938 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:39:48 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:39:48 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:39:48 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:39:48 user nova-compute[75340]:   <serial>a86df738-3c06-4aba-b052-51df3c5c5fe1</serial>
Nov 30 09:39:48 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:39:48 user nova-compute[75340]: </disk>
Nov 30 09:39:48 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:39:48 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully detached device vdb from instance e6828092-aa0c-48fd-866c-ac832b080938 from the persistent domain config.
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6828092-aa0c-48fd-866c-ac832b080938 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:39:48 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:39:48 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:39:48 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:39:48 user nova-compute[75340]:   <serial>a86df738-3c06-4aba-b052-51df3c5c5fe1</serial>
Nov 30 09:39:48 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 09:39:48 user nova-compute[75340]: </disk>
Nov 30 09:39:48 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing instance network info cache due to event network-changed-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:39:49 user nova-compute[75340]: DEBUG nova.network.neutron [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Refreshing network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:39:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated VIF entry in instance network info cache for port 2929a82b-85c5-4f89-bfa5-15df6cb1cb7d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:39:50 user nova-compute[75340]: DEBUG nova.network.neutron [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:39:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4570bf25-e7e6-4d01-baad-ba302449e6bc req-ab34ea4e-84cc-42e9-b424-8bfba8501cd5 service nova] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:39:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:39:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:39:55 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [{"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-e6828092-aa0c-48fd-866c-ac832b080938" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:39:56 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:39:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:39:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:58 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.174545288085938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance e6828092-aa0c-48fd-866c-ac832b080938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c0028250-40b7-45e4-afc3-8928a910450d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:39:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:04 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6828092-aa0c-48fd-866c-ac832b080938 is timed out.
Nov 30 09:40:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully detached device vdb from instance e6828092-aa0c-48fd-866c-ac832b080938 from the live domain config.
Nov 30 09:40:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsOULQju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:40:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c641eb24-eef0-401b-b470-f99756fdc98b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:40:09 user nova-compute[75340]: No targets found.
Nov 30 09:40:09 user nova-compute[75340]: iSNS:
Nov 30 09:40:09 user nova-compute[75340]: No targets found.
Nov 30 09:40:09 user nova-compute[75340]: STATIC:
Nov 30 09:40:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd
Nov 30 09:40:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:40:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:40:09 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1
Nov 30 09:40:09 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:40:09 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:40:09 user nova-compute[75340]: FIRMWARE:
Nov 30 09:40:09 user nova-compute[75340]: No targets found.
Nov 30 09:40:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:40:09 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:40:09 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaee0b8d-3476-4b24-9b76-28e75b0987f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa2a58-3307-4a4a-b808-384a21fa3002]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:40:09 user nova-compute[75340]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:40:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 (non-flash)
Nov 30 09:40:09 user nova-compute[75340]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:40:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305c6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da656b-d13d-47fd-b387-67488d3807ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2422175-adcf-470d-a116-15ae22d2f5a1]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24f3f5-d292-4e38-8d8d-6c3a1675ebcb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d558721-f728-4aad-80e3-7d8e92c0d58e]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f7cd3-9a10-4430-873b-3f9bec823190]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba11ea-d814-4d15-a34b-5c6511047893]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260]
Nov 30 09:40:09 user nova-compute[75340]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1, portal: 172.16.0.220,3260] successful.
Nov 30 09:40:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86df738-3c06-4aba-b052-51df3c5c5fe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc2535c-8631-46c4-bcc5-e58a8806ea62]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== disconnect_volume: return (291ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:40:10 user nova-compute[75340]: DEBUG nova.objects.instance [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:40:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-7db05e6e-2ff1-4a0e-94d8-5aea77e1d010 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:40:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:40:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:40:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:43 user nova-compute[75340]: INFO nova.compute.manager [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Terminating instance
Nov 30 09:40:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:40:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-80e9491a-eb8f-4164-82fb-768265db15e1 req-a759f360-beea-4fd1-bfc4-34f2b3209af4 service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-unplugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Instance destroyed successfully.
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'resources' on Instance uuid e6828092-aa0c-48fd-866c-ac832b080938 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-87139045',display_name='tempest-TestMinimumBasicScenario-server-87139045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-87139045',id=42,image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1h8tzCGtilsC9imzPXHmhk5llT68hEdnWOnP+lMtZZYNeXm0HQYIcqFzD2FVGqb92oLfkVpDoRlpm0ebvLUyUkeVg2W+VClz8knYA6yr9XL0nOSWuB3pt199acvjbow==',key_name='tempest-TestMinimumBasicScenario-538322611',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-zr1xvxb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85cd8986-7951-4a52-a0f5-e27a7d393f72',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:38:03Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=e6828092-aa0c-48fd-866c-ac832b080938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "address": "fa:16:3e:53:ec:44", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2929a82b-85", "ovs_interfaceid": "2929a82b-85c5-4f89-bfa5-15df6cb1cb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG os_vif [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2929a82b-85, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e127b9a1-5086-4234-baf1-0883386b46fc) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:44 user nova-compute[75340]: INFO os_vif [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ec:44,bridge_name='br-int',has_traffic_filtering=True,id=2929a82b-85c5-4f89-bfa5-15df6cb1cb7d,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2929a82b-85')
Nov 30 09:40:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Deleting instance files /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938_del
Nov 30 09:40:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Deletion of /opt/stack/data/nova/instances/e6828092-aa0c-48fd-866c-ac832b080938_del complete
Nov 30 09:40:44 user nova-compute[75340]: INFO nova.compute.manager [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 09:40:44 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:40:44 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Took 0.51 seconds to deallocate network for instance.
Nov 30 09:40:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:45 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Deleted allocations for instance e6828092-aa0c-48fd-866c-ac832b080938
Nov 30 09:40:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a41b1c-1b4d-4221-95b4-77f6006e342c tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "e6828092-aa0c-48fd-866c-ac832b080938" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.742s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-changed-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Refreshing instance network info cache due to event network-changed-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] Acquiring lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] Acquired lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:40:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Refreshing network info cache for port 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] Acquiring lock "e6828092-aa0c-48fd-866c-ac832b080938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] Lock "e6828092-aa0c-48fd-866c-ac832b080938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] No waiting events found dispatching network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:40:46 user nova-compute[75340]: WARNING nova.compute.manager [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received unexpected event network-vif-plugged-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d for instance with vm_state deleted and task_state None.
Nov 30 09:40:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-c4977516-30e0-48cd-a586-6c56284e4943 req-d39b553f-4db1-4c7a-9ee8-e3bfa582a9be service nova] [instance: e6828092-aa0c-48fd-866c-ac832b080938] Received event network-vif-deleted-2929a82b-85c5-4f89-bfa5-15df6cb1cb7d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG nova.network.neutron [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updated VIF entry in instance network info cache for port 1aa1f27d-b3d3-4a3d-b5cd-97a40158808c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG nova.network.neutron [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:40:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-475d6e9a-2f66-4711-9b54-b8d41367a34c req-18110a19-9724-4e41-b0a3-b30e8aa6cca9 service nova] Releasing lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:40:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:40:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:52 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid c0028250-40b7-45e4-afc3-8928a910450d {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "c0028250-40b7-45e4-afc3-8928a910450d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "c0028250-40b7-45e4-afc3-8928a910450d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:40:53 user nova-compute[75340]: INFO nova.compute.claims [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Claim successful on node user
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:40:53 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:40:53 user nova-compute[75340]: DEBUG nova.policy [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:40:53 user nova-compute[75340]: INFO nova.virt.block_device [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Booting with volume snapshot 40c798fe-15ed-4c7f-b951-18448854c5ba at /dev/vda
Nov 30 09:40:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:54 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Successfully created port: 2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Successfully updated port: 2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-changed-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Refreshing instance network info cache due to event network-changed-2a09b4a0-cd8a-4411-8b71-8e7871983654. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] Acquiring lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.network.neutron [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updating instance_info_cache with network_info: [{"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Instance network_info: |[{"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] Acquired lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:40:55 user nova-compute[75340]: DEBUG nova.network.neutron [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Refreshing network info cache for port 2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:40:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updated VIF entry in instance network info cache for port 2a09b4a0-cd8a-4411-8b71-8e7871983654. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:40:56 user nova-compute[75340]: DEBUG nova.network.neutron [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updating instance_info_cache with network_info: [{"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:40:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b6d452a1-eee5-48aa-bffb-b72f43fd3a36 req-ca5e47a1-1123-44f3-b910-58c177f5aad3 service nova] Releasing lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:40:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:40:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:40:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:40:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:40:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:40:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:40:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.201122283935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c0028250-40b7-45e4-afc3-8928a910450d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8a1ee51c-1144-48a1-9558-736abba68690 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG os_brick.utils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:40:59 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[def3dad2-130c-4c56-8348-9338cfd40ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aaf909-6c4f-4e64-a0f0-4b8387dbf5ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84adb85-51d8-403a-8567-af502992c489]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ee3f4-a542-446d-8779-d8a55affc4e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:41:00 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:41:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c4559a-a9fb-4905-af6f-f2c175835e57]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG os_brick.utils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:41:00 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updating existing volume attachment record: faccb228-94ea-4d0d-b457-5c11a6dec25e {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:41:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing instance network info cache due to event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:41:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:41:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:41:03 user nova-compute[75340]: DEBUG nova.network.neutron [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updated VIF entry in instance network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG nova.network.neutron [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3f4e9ea8-9b4c-407c-89ea-8fd29bee1a7b req-dc6854ea-e671-4909-85d6-f09cfc3a9d8a service nova] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:04 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:07 user nova-compute[75340]: INFO nova.compute.manager [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Shelving
Nov 30 09:41:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:07 user nova-compute[75340]: DEBUG nova.compute.manager [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:07 user nova-compute[75340]: WARNING nova.compute.manager [req-07b77c31-3688-4c84-be65-abd878e7e54d req-15b3a253-3a58-42bd-9e64-0aff8212295c service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state active and task_state shelving.
Nov 30 09:41:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance destroyed successfully.
Nov 30 09:41:08 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Beginning cold snapshot process
Nov 30 09:41:08 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:41:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk /opt/stack/data/nova/instances/snapshots/tmp5u8zim6j/52e7bba380b046d9812b62be55d1897c {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk /opt/stack/data/nova/instances/snapshots/tmp5u8zim6j/52e7bba380b046d9812b62be55d1897c" returned: 0 in 0.779s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Snapshot extracted, beginning image upload
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:41:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Creating image(s)
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Ensure instance console log exists: /opt/stack/data/nova/instances/8a1ee51c-1144-48a1-9558-736abba68690/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Start _get_guest_xml network_info=[{"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T09:40:47Z,direct_url=<?>,disk_format='qcow2',id=5afe45aa-186c-4976-984e-7f75d3bfbd73,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1094825400',owner='44adf4b9fd2b47559a452ee5d13876e6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T09:40:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'faccb228-94ea-4d0d-b457-5c11a6dec25e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjQAXEzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a1ee51c-1144-48a1-9558-736abba68690', 'attached_at': '', 'detached_at': '', 'volume_id': '769d44c6-edb6-4d8a-83af-8e2f22942536', 'serial': '769d44c6-edb6-4d8a-83af-8e2f22942536'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:41:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:41:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T09:40:47Z,direct_url=<?>,disk_format='qcow2',id=5afe45aa-186c-4976-984e-7f75d3bfbd73,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1094825400',owner='44adf4b9fd2b47559a452ee5d13876e6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T09:40:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjQAXEzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:41:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:41:09 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:41:09 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fed684-d30c-45c8-8bf6-be659ec63fd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:41:09 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee726d6e-637a-41bd-85dc-70666b828332]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536] added
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[818253c8-96bf-42c6-8d4e-ec92e33c3da0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec6bfe1-0dea-4c15-b12d-cb52bc70affc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjQAXEzS {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjQAXEzS" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8081d0d-c662-4344-b327-f12619d6a0ce]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjQAXEzS'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d00341-06fe-4ab0-9ffd-c2a0192ab8ce]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a520a91-17d1-4b43-bf6a-016cf54d7781]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4eaf7b-c249-4c1c-838a-77e240698906]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260]
Nov 30 09:41:09 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260] successful.
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b32a4-ab15-4dfe-8ff9-031ca8efc179]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87db2b-507d-472c-8997-f6ef384b6045]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:41:09 user nova-compute[75340]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:41:09 user nova-compute[75340]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)
Nov 30 09:41:09 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ef8de2-b416-4445-8a96-cee2fe5f7031]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:09 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:09 user nova-compute[75340]: WARNING nova.compute.manager [req-2ad10b75-7ab2-4990-9b30-8a44ba64d1a6 req-7e450128-96ca-467d-a31a-89452d3c9932 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 09:41:10 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjQAXEzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23263346164626238', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263346164626238', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-272267691',id=47,image_ref='5afe45aa-186c-4976-984e-7f75d3bfbd73',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLet0ao7r8m/p2WkK6dJh9Hp6V56vgAJkytg0OmY9ESf3ggmYkw46lhL+MuSsKH9fMFDrkW4AXg7TQ9OkkJeW0msLjROqY15OmYZHEtxbVFaub+66twHduPjO/wqq1Y2fg==',key_name='tempest-keypair-138742103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-q907ltxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2091409042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8a1ee51c-1144-48a1-9558-736abba68690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.objects.instance [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a1ee51c-1144-48a1-9558-736abba68690 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:41:10 user nova-compute[75340]:   <uuid>8a1ee51c-1144-48a1-9558-736abba68690</uuid>
Nov 30 09:41:10 user nova-compute[75340]:   <name>instance-0000002f</name>
Nov 30 09:41:10 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:41:10 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:41:10 user nova-compute[75340]:   <metadata>
Nov 30 09:41:10 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:41:10 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-272267691</nova:name>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:41:09</nova:creationTime>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:41:10 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:41:10 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:owner>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:41:10 user nova-compute[75340]:       </nova:owner>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:root type="image" uuid="5afe45aa-186c-4976-984e-7f75d3bfbd73"/>
Nov 30 09:41:10 user nova-compute[75340]:       <nova:ports>
Nov 30 09:41:10 user nova-compute[75340]:         <nova:port uuid="2a09b4a0-cd8a-4411-8b71-8e7871983654">
Nov 30 09:41:10 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 09:41:10 user nova-compute[75340]:         </nova:port>
Nov 30 09:41:10 user nova-compute[75340]:       </nova:ports>
Nov 30 09:41:10 user nova-compute[75340]:     </nova:instance>
Nov 30 09:41:10 user nova-compute[75340]:   </metadata>
Nov 30 09:41:10 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:41:10 user nova-compute[75340]:     <system>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="serial">8a1ee51c-1144-48a1-9558-736abba68690</entry>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="uuid">8a1ee51c-1144-48a1-9558-736abba68690</entry>
Nov 30 09:41:10 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:41:10 user nova-compute[75340]:     </system>
Nov 30 09:41:10 user nova-compute[75340]:   </sysinfo>
Nov 30 09:41:10 user nova-compute[75340]:   <os>
Nov 30 09:41:10 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:41:10 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:41:10 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:41:10 user nova-compute[75340]:   </os>
Nov 30 09:41:10 user nova-compute[75340]:   <features>
Nov 30 09:41:10 user nova-compute[75340]:     <acpi/>
Nov 30 09:41:10 user nova-compute[75340]:     <apic/>
Nov 30 09:41:10 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:41:10 user nova-compute[75340]:   </features>
Nov 30 09:41:10 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:41:10 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:41:10 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:41:10 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:41:10 user nova-compute[75340]:   </clock>
Nov 30 09:41:10 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:41:10 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:41:10 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:41:10 user nova-compute[75340]:   </cpu>
Nov 30 09:41:10 user nova-compute[75340]:   <devices>
Nov 30 09:41:10 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:41:10 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:41:10 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:41:10 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:41:10 user nova-compute[75340]:       <serial>769d44c6-edb6-4d8a-83af-8e2f22942536</serial>
Nov 30 09:41:10 user nova-compute[75340]:     </disk>
Nov 30 09:41:10 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:41:10 user nova-compute[75340]:       <mac address="fa:16:3e:7a:60:45"/>
Nov 30 09:41:10 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:41:10 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:41:10 user nova-compute[75340]:       <target dev="tap2a09b4a0-cd"/>
Nov 30 09:41:10 user nova-compute[75340]:     </interface>
Nov 30 09:41:10 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:41:10 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/8a1ee51c-1144-48a1-9558-736abba68690/console.log" append="off"/>
Nov 30 09:41:10 user nova-compute[75340]:     </serial>
Nov 30 09:41:10 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:41:10 user nova-compute[75340]:     <video>
Nov 30 09:41:10 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:41:10 user nova-compute[75340]:     </video>
Nov 30 09:41:10 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:41:10 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:41:10 user nova-compute[75340]:     </rng>
Nov 30 09:41:10 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:41:10 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:41:10 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:41:10 user nova-compute[75340]:     </memballoon>
Nov 30 09:41:10 user nova-compute[75340]:   </devices>
Nov 30 09:41:10 user nova-compute[75340]: </domain>
Nov 30 09:41:10 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-272267691',id=47,image_ref='5afe45aa-186c-4976-984e-7f75d3bfbd73',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLet0ao7r8m/p2WkK6dJh9Hp6V56vgAJkytg0OmY9ESf3ggmYkw46lhL+MuSsKH9fMFDrkW4AXg7TQ9OkkJeW0msLjROqY15OmYZHEtxbVFaub+66twHduPjO/wqq1Y2fg==',key_name='tempest-keypair-138742103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-q907ltxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2091409042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8a1ee51c-1144-48a1-9558-736abba68690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG os_vif [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '469f3e3e-3f16-5599-baed-6c99efbbc7ae', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a09b4a0-cd, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a09b4a0-cd, col_values=(('qos', UUID('8f674490-1248-4d68-b1a4-e49ef6aa8b1f')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a09b4a0-cd, col_values=(('external_ids', {'iface-id': '2a09b4a0-cd8a-4411-8b71-8e7871983654', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:60:45', 'vm-uuid': '8a1ee51c-1144-48a1-9558-736abba68690'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:10 user nova-compute[75340]: INFO os_vif [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd')
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:41:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:7a:60:45, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:41:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Snapshot image upload complete
Nov 30 09:41:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:41:11 user nova-compute[75340]: INFO nova.compute.manager [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Shelve offloading
Nov 30 09:41:11 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance destroyed successfully.
Nov 30 09:41:11 user nova-compute[75340]: DEBUG nova.compute.manager [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:41:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:41:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:41:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:41:11 user nova-compute[75340]: DEBUG nova.network.neutron [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:41:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:12 user nova-compute[75340]: DEBUG nova.compute.manager [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] No waiting events found dispatching network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:12 user nova-compute[75340]: WARNING nova.compute.manager [req-09ead4a6-8276-4fbf-b302-72e02075cb28 req-d052add9-8b57-4261-8cd2-7b616f0de081 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received unexpected event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 for instance with vm_state building and task_state spawning.
Nov 30 09:41:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance destroyed successfully.
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.objects.instance [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'resources' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfwaxpEdJsXFYVE88eGrMcxXL4BBgXD9zvHpieOvq+ilGAnCGqBSACDoJcVUx7IHE6wM5nwv3GbOCPESGF9Sxi4Fm1QwmopCGWl623NczwROHfH8EjkHAOoTyvMVTF3ZQ==',key_name='tempest-keypair-1121072342',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:41:11.350316',shelved_host='user',shelved_image_id='ea2572b9-3047-4e0d-8036-4698df5936a1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG os_vif [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdbd9421-e5, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6949643b-02fb-4db3-a105-c2e358ad10f2) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:13 user nova-compute[75340]: INFO os_vif [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5')
Nov 30 09:41:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Deleting instance files /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7_del
Nov 30 09:41:13 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Deletion of /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7_del complete
Nov 30 09:41:13 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Deleted allocations for instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7
Nov 30 09:41:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.objects.instance [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'numa_topology' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.objects.base [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7> lazy-loaded attributes: resources,numa_topology {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-647d13f7-fd24-4841-9058-c06a65868351 tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.097s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:41:14 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Instance spawned successfully.
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:14 user nova-compute[75340]: INFO nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:14 user nova-compute[75340]: INFO nova.compute.manager [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Took 20.96 seconds to build instance.
Nov 30 09:41:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-72e6e2a3-9c7d-494f-8e48-1f4ea44ebd64 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.068s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:14 user nova-compute[75340]: DEBUG nova.compute.manager [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] No waiting events found dispatching network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:14 user nova-compute[75340]: WARNING nova.compute.manager [req-a26c8877-5f87-4ef0-9758-7b06761fc420 req-f53d3e5d-4b6e-4648-a4b9-17d5894fab1a service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received unexpected event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 for instance with vm_state active and task_state None.
Nov 30 09:41:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:41:37 user nova-compute[75340]: INFO nova.compute.claims [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Claim successful on node user
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:41:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.policy [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bbb4a25e58849c89e71d22727b082b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c44e90da98479fb459142c4acb01ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:41:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Creating image(s)
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "/opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "/opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Successfully created port: 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.part --force-share --output=json" returned: 0 in 0.238s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG nova.virt.images [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] aa2cd67e-895f-47ad-b5aa-9f6824c56b4b was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.part /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.part /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.converted" returned: 0 in 0.438s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.482s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:39 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json" returned: 0 in 0.226s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Successfully updated port: 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing instance network info cache due to event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json" returned: 0 in 0.205s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4,backing_fmt=raw /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4,backing_fmt=raw /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk 1073741824" returned: 0 in 0.063s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "1022ca467ee8ac6178138b27d4c6f58fc02535e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.neutron [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance network_info: |[{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Cannot resize image /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Ensure instance console log exists: /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Start _get_guest_xml network_info=[{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:41:35Z,direct_url=<?>,disk_format='qcow2',id=aa2cd67e-895f-47ad-b5aa-9f6824c56b4b,min_disk=0,min_ram=0,name='tempest-scenario-img--1078277466',owner='59c44e90da98479fb459142c4acb01ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:41:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'aa2cd67e-895f-47ad-b5aa-9f6824c56b4b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:41:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:41:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:41:35Z,direct_url=<?>,disk_format='qcow2',id=aa2cd67e-895f-47ad-b5aa-9f6824c56b4b,min_disk=0,min_ram=0,name='tempest-scenario-img--1078277466',owner='59c44e90da98479fb459142c4acb01ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:41:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1060269847',display_name='tempest-TestMinimumBasicScenario-server-1060269847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1060269847',id=48,image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuT+WdPAULx3tTvlMEFbVVUolKGIEjdNvoV9LvVNGRcmwKyOB5ebfkgXUxKqp8r43MOJI6xUjm3ZqS0Yt11EZk4c3JVpOk1eFZ3o1TMwAdx64JpiVZRhxMYURJtNpHheA==',key_name='tempest-TestMinimumBasicScenario-459010262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-i20zfqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:41:38Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=fe25a6bb-c3c7-43ab-a09e-7f2d3003c774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'pci_devices' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:41:40 user nova-compute[75340]:   <uuid>fe25a6bb-c3c7-43ab-a09e-7f2d3003c774</uuid>
Nov 30 09:41:40 user nova-compute[75340]:   <name>instance-00000030</name>
Nov 30 09:41:40 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:41:40 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:41:40 user nova-compute[75340]:   <metadata>
Nov 30 09:41:40 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:41:40 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:name>tempest-TestMinimumBasicScenario-server-1060269847</nova:name>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:41:40</nova:creationTime>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:41:40 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:41:40 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:owner>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:user uuid="0bbb4a25e58849c89e71d22727b082b7">tempest-TestMinimumBasicScenario-627001043-project-member</nova:user>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:project uuid="59c44e90da98479fb459142c4acb01ea">tempest-TestMinimumBasicScenario-627001043</nova:project>
Nov 30 09:41:40 user nova-compute[75340]:       </nova:owner>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:root type="image" uuid="aa2cd67e-895f-47ad-b5aa-9f6824c56b4b"/>
Nov 30 09:41:40 user nova-compute[75340]:       <nova:ports>
Nov 30 09:41:40 user nova-compute[75340]:         <nova:port uuid="64a8813a-a6d2-439c-a76d-fe5f04853a8c">
Nov 30 09:41:40 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 09:41:40 user nova-compute[75340]:         </nova:port>
Nov 30 09:41:40 user nova-compute[75340]:       </nova:ports>
Nov 30 09:41:40 user nova-compute[75340]:     </nova:instance>
Nov 30 09:41:40 user nova-compute[75340]:   </metadata>
Nov 30 09:41:40 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:41:40 user nova-compute[75340]:     <system>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="serial">fe25a6bb-c3c7-43ab-a09e-7f2d3003c774</entry>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="uuid">fe25a6bb-c3c7-43ab-a09e-7f2d3003c774</entry>
Nov 30 09:41:40 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:41:40 user nova-compute[75340]:     </system>
Nov 30 09:41:40 user nova-compute[75340]:   </sysinfo>
Nov 30 09:41:40 user nova-compute[75340]:   <os>
Nov 30 09:41:40 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:41:40 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:41:40 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:41:40 user nova-compute[75340]:   </os>
Nov 30 09:41:40 user nova-compute[75340]:   <features>
Nov 30 09:41:40 user nova-compute[75340]:     <acpi/>
Nov 30 09:41:40 user nova-compute[75340]:     <apic/>
Nov 30 09:41:40 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:41:40 user nova-compute[75340]:   </features>
Nov 30 09:41:40 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:41:40 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:41:40 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:41:40 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:41:40 user nova-compute[75340]:   </clock>
Nov 30 09:41:40 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:41:40 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:41:40 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:41:40 user nova-compute[75340]:   </cpu>
Nov 30 09:41:40 user nova-compute[75340]:   <devices>
Nov 30 09:41:40 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:41:40 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:41:40 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk"/>
Nov 30 09:41:40 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:41:40 user nova-compute[75340]:     </disk>
Nov 30 09:41:40 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:41:40 user nova-compute[75340]:       <mac address="fa:16:3e:71:79:fd"/>
Nov 30 09:41:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:41:40 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:41:40 user nova-compute[75340]:       <target dev="tap64a8813a-a6"/>
Nov 30 09:41:40 user nova-compute[75340]:     </interface>
Nov 30 09:41:40 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:41:40 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/console.log" append="off"/>
Nov 30 09:41:40 user nova-compute[75340]:     </serial>
Nov 30 09:41:40 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:41:40 user nova-compute[75340]:     <video>
Nov 30 09:41:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:41:40 user nova-compute[75340]:     </video>
Nov 30 09:41:40 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:41:40 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:41:40 user nova-compute[75340]:     </rng>
Nov 30 09:41:40 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:41:40 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:41:40 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:41:40 user nova-compute[75340]:     </memballoon>
Nov 30 09:41:40 user nova-compute[75340]:   </devices>
Nov 30 09:41:40 user nova-compute[75340]: </domain>
Nov 30 09:41:40 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1060269847',display_name='tempest-TestMinimumBasicScenario-server-1060269847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1060269847',id=48,image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuT+WdPAULx3tTvlMEFbVVUolKGIEjdNvoV9LvVNGRcmwKyOB5ebfkgXUxKqp8r43MOJI6xUjm3ZqS0Yt11EZk4c3JVpOk1eFZ3o1TMwAdx64JpiVZRhxMYURJtNpHheA==',key_name='tempest-TestMinimumBasicScenario-459010262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-i20zfqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:41:38Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=fe25a6bb-c3c7-43ab-a09e-7f2d3003c774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG os_vif [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e42e6f31-8178-5258-9195-7944611b226c', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a8813a-a6, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a8813a-a6, col_values=(('qos', UUID('0fea5311-b724-4c41-a28f-3b29e4167591')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a8813a-a6, col_values=(('external_ids', {'iface-id': '64a8813a-a6d2-439c-a76d-fe5f04853a8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:79:fd', 'vm-uuid': 'fe25a6bb-c3c7-43ab-a09e-7f2d3003c774'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:40 user nova-compute[75340]: INFO os_vif [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6')
Nov 30 09:41:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:41:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No VIF found with MAC fa:16:3e:71:79:fd, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:41:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated VIF entry in instance network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:41:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:41:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5fec49d9-d8a0-4f3e-a91a-a0dc6d72c09e req-feeb8acd-1109-432a-86b0-9e42ab2a3131 service nova] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:42 user nova-compute[75340]: WARNING nova.compute.manager [req-f74e6f55-662b-4745-a782-7deb37b3d51b req-04e25dba-10ef-427d-80dd-c3eecb5807f0 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state building and task_state spawning.
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:44 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance spawned successfully.
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:41:44 user nova-compute[75340]: INFO nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:41:44 user nova-compute[75340]: INFO nova.compute.manager [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Took 6.73 seconds to build instance.
Nov 30 09:41:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d3766933-eca5-4957-9af8-6576ea2edcb6 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:41:44 user nova-compute[75340]: WARNING nova.compute.manager [req-3223bbcf-bfdd-4fa8-963f-cdb853cb985e req-9db05600-2d14-4d3f-9807-ae1fea7b9550 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state active and task_state None.
Nov 30 09:41:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:41:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:41:59 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:42:00 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:42:00 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=25.130306243896484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c0028250-40b7-45e4-afc3-8928a910450d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8a1ee51c-1144-48a1-9558-736abba68690 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:42:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-changed-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Refreshing instance network info cache due to event network-changed-2a09b4a0-cd8a-4411-8b71-8e7871983654. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] Acquiring lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] Acquired lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Refreshing network info cache for port 2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updated VIF entry in instance network info cache for port 2a09b4a0-cd8a-4411-8b71-8e7871983654. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updating instance_info_cache with network_info: [{"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:42:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3b6abdc2-d4c8-4f6b-bd6b-2480c39d04c0 req-126e58d2-5ae9-4b3c-a529-2a75cdefc0cb service nova] Releasing lock "refresh_cache-8a1ee51c-1144-48a1-9558-736abba68690" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:45 user nova-compute[75340]: INFO nova.compute.manager [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Terminating instance
Nov 30 09:42:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-unplugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] No waiting events found dispatching network-vif-unplugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-e7e30a1b-e984-43cb-8c1e-1b69d3577ce5 req-5e50da55-552d-460f-b5bc-494f78327127 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-unplugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Instance destroyed successfully.
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid 8a1ee51c-1144-48a1-9558-736abba68690 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-272267691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-272267691',id=47,image_ref='5afe45aa-186c-4976-984e-7f75d3bfbd73',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLet0ao7r8m/p2WkK6dJh9Hp6V56vgAJkytg0OmY9ESf3ggmYkw46lhL+MuSsKH9fMFDrkW4AXg7TQ9OkkJeW0msLjROqY15OmYZHEtxbVFaub+66twHduPjO/wqq1Y2fg==',key_name='tempest-keypair-138742103',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:41:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-q907ltxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2091409042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8a1ee51c-1144-48a1-9558-736abba68690,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "address": "fa:16:3e:7a:60:45", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a09b4a0-cd", "ovs_interfaceid": "2a09b4a0-cd8a-4411-8b71-8e7871983654", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_vif [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a09b4a0-cd, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f674490-1248-4d68-b1a4-e49ef6aa8b1f) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:46 user nova-compute[75340]: INFO os_vif [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:60:45,bridge_name='br-int',has_traffic_filtering=True,id=2a09b4a0-cd8a-4411-8b71-8e7871983654,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a09b4a0-cd')
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjQAXEzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:42:46 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3006e72b-adc3-4c79-800a-f5340b7c0102]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:42:46 user nova-compute[75340]: No targets found.
Nov 30 09:42:46 user nova-compute[75340]: iSNS:
Nov 30 09:42:46 user nova-compute[75340]: No targets found.
Nov 30 09:42:46 user nova-compute[75340]: STATIC:
Nov 30 09:42:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd
Nov 30 09:42:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:42:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:42:46 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536
Nov 30 09:42:46 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:42:46 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:42:46 user nova-compute[75340]: FIRMWARE:
Nov 30 09:42:46 user nova-compute[75340]: No targets found.
Nov 30 09:42:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:42:46 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:42:46 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb9b3dd-d5c6-4030-9dd9-102ec44878c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd867af2-f457-4804-bea6-dd51c56b7b09]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:42:46 user nova-compute[75340]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)
Nov 30 09:42:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:42:46 user nova-compute[75340]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 (non-flash)
Nov 30 09:42:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5014a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb862db-af55-4d5b-a03e-df28c671a1e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa9898-8b89-4f00-8a0c-5fb0728c8b21]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412f201-31b7-4249-8eea-0e128640720e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b1233-20ad-4ef2-ba1d-bf174c81ce13]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23263346164626238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c4e3fc1', '/dev/disk/by-id/scsi-1SCST_BIO3c4e3fc1-2c4adbb890c15925') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1856daf-70bd-4db5-a9e6-be96443fcf1c]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764d0f0-e4a9-4b5f-8234-3f2538514346]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a52b8-0e25-423d-9001-fd06a8dd9a90]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260]
Nov 30 09:42:46 user nova-compute[75340]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536, portal: 172.16.0.220,3260] successful.
Nov 30 09:42:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769d44c6-edb6-4d8a-83af-8e2f22942536 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6215c5-5d6d-415b-9be0-8918863e4aaa]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (303ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:42:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Deleting instance files /opt/stack/data/nova/instances/8a1ee51c-1144-48a1-9558-736abba68690_del
Nov 30 09:42:46 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Deletion of /opt/stack/data/nova/instances/8a1ee51c-1144-48a1-9558-736abba68690_del complete
Nov 30 09:42:46 user nova-compute[75340]: INFO nova.compute.manager [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 09:42:46 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:42:46 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:42:47 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:42:47 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Took 0.70 seconds to deallocate network for instance.
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] Acquiring lock "8a1ee51c-1144-48a1-9558-736abba68690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] Lock "8a1ee51c-1144-48a1-9558-736abba68690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] No waiting events found dispatching network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:42:48 user nova-compute[75340]: WARNING nova.compute.manager [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received unexpected event network-vif-plugged-2a09b4a0-cd8a-4411-8b71-8e7871983654 for instance with vm_state active and task_state deleting.
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.compute.manager [req-42ff6b37-b20f-458f-b445-7938639a2782 req-f721791a-72c6-43ac-b542-3807fe0fbb40 service nova] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Received event network-vif-deleted-2a09b4a0-cd8a-4411-8b71-8e7871983654 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:42:48 user nova-compute[75340]: INFO nova.compute.manager [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Took 0.78 seconds to detach 1 volumes for instance.
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8a1ee51c-1144-48a1-9558-736abba68690] Deleting volume: 769d44c6-edb6-4d8a-83af-8e2f22942536 {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:48 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance 8a1ee51c-1144-48a1-9558-736abba68690
Nov 30 09:42:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-523d11e5-192e-4fb4-8b79-f1ef70b5e16b tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8a1ee51c-1144-48a1-9558-736abba68690" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.060s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:42:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:42:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:42:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:55 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:42:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid c0028250-40b7-45e4-afc3-8928a910450d {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:00 user nova-compute[75340]: INFO nova.compute.manager [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Unshelving
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_requests' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'numa_topology' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:43:00 user nova-compute[75340]: INFO nova.compute.claims [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Claim successful on node user
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [{"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-c0028250-40b7-45e4-afc3-8928a910450d" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.107s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:43:00 user nova-compute[75340]: INFO nova.network.neutron [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating port fdbd9421-e567-4b3a-bd7b-442868a99815 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing instance network info cache due to event network-changed-fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] Acquiring lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:43:01 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:43:01 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.127532958984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance c0028250-40b7-45e4-afc3-8928a910450d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (0b79bb92-a015-438b-9e5d-504678a00853): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:43:01 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Creating image(s)
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] Acquired lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.network.neutron [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Refreshing network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG nova.objects.base [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.part --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG nova.virt.images [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] ea2572b9-3047-4e0d-8036-4698df5936a1 was qcow2, converting to raw {{(pid=75340) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG nova.privsep.utils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75340) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.part /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.converted {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG nova.network.neutron [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updated VIF entry in instance network info cache for port fdbd9421-e567-4b3a-bd7b-442868a99815. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG nova.network.neutron [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-38ab839a-1ce6-479c-9ed7-a1485999531e req-06660449-97f1-4108-a3f2-160fc8b45179 service nova] Releasing lock "refresh_cache-a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.part /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.converted" returned: 0 in 0.406s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.converted --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.845s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:03 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c,backing_fmt=raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c,backing_fmt=raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'migration_context' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG nova.objects.base [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:43:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Rebasing disk image.
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:04 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb -F raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb -F raw /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk" returned: 0 in 2.153s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Ensure instance console log exists: /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start _get_guest_xml network_info=[{"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c939e501a0bb5da3cfe032d03cb6b279',container_format='bare',created_at=2023-11-30T09:41:07Z,direct_url=<?>,disk_format='qcow2',id=ea2572b9-3047-4e0d-8036-4698df5936a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-461451209-shelved',owner='a90a6d95b1ed43879eca5e07be0a4276',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T09:41:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:43:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:43:06 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c939e501a0bb5da3cfe032d03cb6b279',container_format='bare',created_at=2023-11-30T09:41:07Z,direct_url=<?>,disk_format='qcow2',id=ea2572b9-3047-4e0d-8036-4698df5936a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-461451209-shelved',owner='a90a6d95b1ed43879eca5e07be0a4276',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T09:41:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.objects.base [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='ea2572b9-3047-4e0d-8036-4698df5936a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1121072342',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:41:11.350316',shelved_host='user',shelved_image_id='ea2572b9-3047-4e0d-8036-4698df5936a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'pci_devices' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.objects.base [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Object Instance<a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75340) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:43:06 user nova-compute[75340]:   <uuid>a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</uuid>
Nov 30 09:43:06 user nova-compute[75340]:   <name>instance-0000002e</name>
Nov 30 09:43:06 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:43:06 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:43:06 user nova-compute[75340]:   <metadata>
Nov 30 09:43:06 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:43:06 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-461451209</nova:name>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:43:06</nova:creationTime>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:43:06 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:43:06 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:owner>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:user uuid="34a31aeeca154620ba74acbaaabcdced">tempest-AttachVolumeShelveTestJSON-1052742553-project-member</nova:user>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:project uuid="a90a6d95b1ed43879eca5e07be0a4276">tempest-AttachVolumeShelveTestJSON-1052742553</nova:project>
Nov 30 09:43:06 user nova-compute[75340]:       </nova:owner>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:root type="image" uuid="ea2572b9-3047-4e0d-8036-4698df5936a1"/>
Nov 30 09:43:06 user nova-compute[75340]:       <nova:ports>
Nov 30 09:43:06 user nova-compute[75340]:         <nova:port uuid="fdbd9421-e567-4b3a-bd7b-442868a99815">
Nov 30 09:43:06 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 09:43:06 user nova-compute[75340]:         </nova:port>
Nov 30 09:43:06 user nova-compute[75340]:       </nova:ports>
Nov 30 09:43:06 user nova-compute[75340]:     </nova:instance>
Nov 30 09:43:06 user nova-compute[75340]:   </metadata>
Nov 30 09:43:06 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:43:06 user nova-compute[75340]:     <system>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="serial">a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</entry>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="uuid">a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7</entry>
Nov 30 09:43:06 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:43:06 user nova-compute[75340]:     </system>
Nov 30 09:43:06 user nova-compute[75340]:   </sysinfo>
Nov 30 09:43:06 user nova-compute[75340]:   <os>
Nov 30 09:43:06 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:43:06 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:43:06 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:43:06 user nova-compute[75340]:   </os>
Nov 30 09:43:06 user nova-compute[75340]:   <features>
Nov 30 09:43:06 user nova-compute[75340]:     <acpi/>
Nov 30 09:43:06 user nova-compute[75340]:     <apic/>
Nov 30 09:43:06 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:43:06 user nova-compute[75340]:   </features>
Nov 30 09:43:06 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:43:06 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:43:06 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:43:06 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:43:06 user nova-compute[75340]:   </clock>
Nov 30 09:43:06 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:43:06 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:43:06 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:43:06 user nova-compute[75340]:   </cpu>
Nov 30 09:43:06 user nova-compute[75340]:   <devices>
Nov 30 09:43:06 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:43:06 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:43:06 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk"/>
Nov 30 09:43:06 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:43:06 user nova-compute[75340]:     </disk>
Nov 30 09:43:06 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:43:06 user nova-compute[75340]:       <mac address="fa:16:3e:2f:9b:10"/>
Nov 30 09:43:06 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:43:06 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:43:06 user nova-compute[75340]:       <target dev="tapfdbd9421-e5"/>
Nov 30 09:43:06 user nova-compute[75340]:     </interface>
Nov 30 09:43:06 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:43:06 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/console.log" append="off"/>
Nov 30 09:43:06 user nova-compute[75340]:     </serial>
Nov 30 09:43:06 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:43:06 user nova-compute[75340]:     <video>
Nov 30 09:43:06 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:43:06 user nova-compute[75340]:     </video>
Nov 30 09:43:06 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:43:06 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:43:06 user nova-compute[75340]:     </rng>
Nov 30 09:43:06 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:43:06 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:43:06 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:43:06 user nova-compute[75340]:     </memballoon>
Nov 30 09:43:06 user nova-compute[75340]:   </devices>
Nov 30 09:43:06 user nova-compute[75340]: </domain>
Nov 30 09:43:06 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='ea2572b9-3047-4e0d-8036-4698df5936a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1121072342',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member',shelved_at='2023-11-30T09:41:11.350316',shelved_host='user',shelved_image_id='ea2572b9-3047-4e0d-8036-4698df5936a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG os_vif [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c98106fc-c18c-5b65-b09a-df2c73a5a279', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdbd9421-e5, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdbd9421-e5, col_values=(('qos', UUID('7f4109d8-672f-4c62-b4a5-622f7574b059')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdbd9421-e5, col_values=(('external_ids', {'iface-id': 'fdbd9421-e567-4b3a-bd7b-442868a99815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:9b:10', 'vm-uuid': 'a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:06 user nova-compute[75340]: INFO os_vif [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5')
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:43:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] No VIF found with MAC fa:16:3e:2f:9b:10, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG nova.compute.manager [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:08 user nova-compute[75340]: WARNING nova.compute.manager [req-66b4e3ad-c366-4a58-a30d-808c373d89c9 req-fe50149f-9c56-4c0e-9f67-4e248c8b9e46 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:43:10 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance spawned successfully.
Nov 30 09:43:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG nova.compute.manager [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:10 user nova-compute[75340]: WARNING nova.compute.manager [req-d1428cc6-78a9-41e1-b827-293d347fb550 req-74b68dcb-c54b-4ca1-904b-2ce94c4a83d1 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 09:43:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:43:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-a1c4f37e-9a55-427e-ae3e-2576fb1415eb tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.427s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:43:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:31 user nova-compute[75340]: INFO nova.compute.manager [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Attaching volume a8123acb-62a6-4628-83ee-475202bf565c to /dev/vdb
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.utils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e3cc2e-a562-4008-8ebb-40367441ce8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[854bcff9-724d-49ef-916b-d81967d7adbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb986f6c-b46f-4475-a0f2-01b80064f1f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc0655-cf2f-4171-87b9-4e60aac3b6d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:43:31 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:43:31 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0571c8-bc3b-425e-8273-c1fd7e859095]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG os_brick.utils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating existing volume attachment record: 929bd2de-5650-4817-b01a-1ce7dd2cc0b5 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:43:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZraLONXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:43:40 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:43:40 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:43:40 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[582074f0-0f23-4df6-9985-a4b1d23992d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:43:40 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe28d7-119c-425b-924e-0889b8beddf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c] added
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc61dc-a79c-4f34-81d3-369c2c5147cf]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462f996-78cf-4dc4-b46e-a8a6b25e7021]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZraLONXI {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZraLONXI" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bf7c97-7372-483c-a636-ac11a2ada4e3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZraLONXI'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ec442-a59e-457e-b5e4-750f9fbb1e99]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6c5f28-f109-4166-a9e2-3eb181957243]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27e07c9-5b68-4e9e-a767-7b3ce1355492]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260]
Nov 30 09:43:40 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260] successful.
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc81805-19df-46f8-a8f2-f441930c21dd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d066a750-b88a-4830-a54f-eec614c27b68]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:40 user nova-compute[75340]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:40 user nova-compute[75340]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:43:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52484c9-3460-4936-a396-6a971dda10fa]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:40 user nova-compute[75340]: INFO nova.compute.manager [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Terminating instance
Nov 30 09:43:40 user nova-compute[75340]: DEBUG nova.compute.manager [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-unplugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] No waiting events found dispatching network-vif-unplugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-78d58e6c-ff37-406e-9380-98473c216848 req-8368d18b-f7c3-467a-89aa-41ddc1b7d2f5 service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-unplugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:43:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Instance destroyed successfully.
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.objects.instance [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid c0028250-40b7-45e4-afc3-8928a910450d {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-790879160',display_name='tempest-TestVolumeBootPattern-volume-backed-server-790879160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-790879160',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE344b+KBUmIYPBQRVgoRATunmkXVNk5LcUkVbQ3RHxQNcEGJLluJHzp4Y9XY785oQRyl4qMgAiA2KrCMsvoGmZKJZFaEC4icOu9zYMi6WIRaOy9+IAFo4D+yOY9QaBp5A==',key_name='tempest-keypair-922701451',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-pexo88of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=c0028250-40b7-45e4-afc3-8928a910450d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "address": "fa:16:3e:10:0a:92", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa1f27d-b3", "ovs_interfaceid": "1aa1f27d-b3d3-4a3d-b5cd-97a40158808c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_vif [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aa1f27d-b3, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c55364d-84cb-498e-8b32-0e3e635ae13e) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:43:41 user nova-compute[75340]: INFO os_vif [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=1aa1f27d-b3d3-4a3d-b5cd-97a40158808c,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa1f27d-b3')
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBnQApNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:43:41 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZraLONXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26239313465663737', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239313465663737', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.162s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.objects.instance [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ba179c-36cc-4f27-95c8-f26f21a453af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:43:41 user nova-compute[75340]: No targets found.
Nov 30 09:43:41 user nova-compute[75340]: iSNS:
Nov 30 09:43:41 user nova-compute[75340]: No targets found.
Nov 30 09:43:41 user nova-compute[75340]: STATIC:
Nov 30 09:43:41 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c
Nov 30 09:43:41 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:43:41 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:43:41 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd
Nov 30 09:43:41 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:43:41 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:43:41 user nova-compute[75340]: FIRMWARE:
Nov 30 09:43:41 user nova-compute[75340]: No targets found.
Nov 30 09:43:41 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:43:41 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:43:41 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:43:41 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:43:41 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:43:41 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:43:41 user nova-compute[75340]:   <serial>a8123acb-62a6-4628-83ee-475202bf565c</serial>
Nov 30 09:43:41 user nova-compute[75340]: </disk>
Nov 30 09:43:41 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc98342-a283-4236-9c74-197237ec0c15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b092008-e9c6-42a4-b51d-0f2bc07bb7a6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:41 user nova-compute[75340]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:43:41 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd (non-flash)
Nov 30 09:43:41 user nova-compute[75340]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:43:41 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305c55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8777a-bdb9-4c6f-a723-6b3c4e0d02c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[000c4f95-8492-492b-853d-b6e81b08ddff]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14632d-1388-4f67-ab57-f784607af4bd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be4864-6e07-4e3d-9861-7c5e75e4207f]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a45a7b-1b2e-4b65-a8ba-e3258a56797b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[62445a1b-eceb-4e7d-b084-fb96f1baef56]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260]
Nov 30 09:43:41 user nova-compute[75340]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd, portal: 172.16.0.220,3260] successful.
Nov 30 09:43:41 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312258d4-81d5-40ce-94a8-21ab47f172bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e01176-1b71-48f1-88e0-bd0427092b85]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (482ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:43:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Deleting instance files /opt/stack/data/nova/instances/c0028250-40b7-45e4-afc3-8928a910450d_del
Nov 30 09:43:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Deletion of /opt/stack/data/nova/instances/c0028250-40b7-45e4-afc3-8928a910450d_del complete
Nov 30 09:43:41 user nova-compute[75340]: INFO nova.compute.manager [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 30 09:43:41 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:43:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] No VIF found with MAC fa:16:3e:71:79:fd, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-016625af-25a3-4d95-ab50-00745491dfd1 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.771s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] Acquiring lock "c0028250-40b7-45e4-afc3-8928a910450d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] Lock "c0028250-40b7-45e4-afc3-8928a910450d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] No waiting events found dispatching network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:42 user nova-compute[75340]: WARNING nova.compute.manager [req-28d121ce-f12f-4083-8e41-d4ce524ef50f req-1ead65a0-6e2a-4388-a583-4bbec564f2fe service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received unexpected event network-vif-plugged-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c for instance with vm_state active and task_state deleting.
Nov 30 09:43:43 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:43 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Took 1.17 seconds to deallocate network for instance.
Nov 30 09:43:43 user nova-compute[75340]: INFO nova.compute.manager [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Took 0.78 seconds to detach 1 volumes for instance.
Nov 30 09:43:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Deleting volume: 312258d4-81d5-40ce-94a8-21ab47f172bd {{(pid=75340) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 09:43:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:43:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:43:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:44 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance c0028250-40b7-45e4-afc3-8928a910450d
Nov 30 09:43:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-701d8592-8d6e-4268-b7f8-845508878cd5 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "c0028250-40b7-45e4-afc3-8928a910450d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.711s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-0d66c460-6e31-4621-a51e-aa22996497b2 req-59d5aaef-03f7-4d33-a942-eaa50b84141c service nova] [instance: c0028250-40b7-45e4-afc3-8928a910450d] Received event network-vif-deleted-1aa1f27d-b3d3-4a3d-b5cd-97a40158808c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing instance network info cache due to event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated VIF entry in instance network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6a3e8a42-9a83-402e-ae38-7ef3fa2543be req-c7708ce2-8379-42ba-8de9-c770925ad243 service nova] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing instance network info cache due to event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:43:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:43:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:43:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated VIF entry in instance network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-47c34516-1665-4117-8728-39b485254754 req-9565642f-6b69-47c0-ab68-c6ef638fd1b8 service nova] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:48 user nova-compute[75340]: INFO nova.compute.manager [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Rebooting instance
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG nova.network.neutron [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:43:48 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:43:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:51 user nova-compute[75340]: WARNING nova.compute.manager [req-fd806c77-1bcd-4665-a442-f9a7e2ff2b23 req-17982fdc-7b88-42b2-8d6c-e24f4d87b1c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state active and task_state reboot_started.
Nov 30 09:43:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:43:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance shutdown successfully.
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:53 user nova-compute[75340]: WARNING nova.compute.manager [req-d578907f-44c0-4496-905c-f1ab84bf507d req-8cefe4fe-5681-44dc-89f6-fb04a4b5db20 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state active and task_state reboot_started.
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance running successfully.
Nov 30 09:43:55 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance soft rebooted successfully.
Nov 30 09:43:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:55 user nova-compute[75340]: WARNING nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state active and task_state reboot_started.
Nov 30 09:43:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:43:55 user nova-compute[75340]: WARNING nova.compute.manager [req-4c25376e-af70-4676-a26c-cea22ca361b3 req-cc7d46ae-384b-4920-9642-151d7a47f4d1 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state active and task_state reboot_started.
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef406e21-acc2-4dc8-af6e-d21354399e0a tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.294s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:43:55 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:43:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:43:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:01 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:44:01 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.092029571533203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:44:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:06 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:11 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:16 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:26 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:44:31 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:44:42 user nova-compute[75340]: INFO nova.compute.claims [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Claim successful on node user
Nov 30 09:44:42 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:44:42 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:44:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.policy [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:44:43 user nova-compute[75340]: INFO nova.virt.block_device [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Booting with volume b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 at /dev/vda
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.utils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[58242160-b2f0-4e58-8410-3bec9eb5dfa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974c5c9-40f1-4537-9871-7e85ae72e715]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40581e3-7de1-4926-a18c-0c74e7e17667]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddab88c-e31d-4bab-a799-9d7dd073904b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:44:43 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:44:43 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bfa31a-aced-4292-ba5a-a101af0abd67]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG os_brick.utils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating existing volume attachment record: c572cb48-3a9c-4d53-8030-254cf691b388 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:44:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Successfully created port: ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Successfully updated port: ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-changed-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Refreshing instance network info cache due to event network-changed-ad923f21-53c9-4b42-865f-7afaf123cf55. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] Acquiring lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating instance_info_cache with network_info: [{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Instance network_info: |[{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] Acquired lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:44:44 user nova-compute[75340]: DEBUG nova.network.neutron [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Refreshing network info cache for port ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:44:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updated VIF entry in instance network info cache for port ad923f21-53c9-4b42-865f-7afaf123cf55. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:44:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating instance_info_cache with network_info: [{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:44:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-87a91135-0f5f-4127-acbd-3419c5772535 req-db60e8f0-3750-45e7-9197-1c9f8fb48c08 service nova] Releasing lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:44:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:50 user nova-compute[75340]: INFO nova.compute.manager [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Terminating instance
Nov 30 09:44:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.compute.manager [req-7b02b106-e71a-46dd-8973-c3b30c7e347d req-6ed5fafd-a60e-4e89-8c8a-903bb98436b6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-unplugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:44:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Instance destroyed successfully.
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lazy-loading 'resources' on Instance uuid a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T09:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-461451209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-461451209',id=46,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfwaxpEdJsXFYVE88eGrMcxXL4BBgXD9zvHpieOvq+ilGAnCGqBSACDoJcVUx7IHE6wM5nwv3GbOCPESGF9Sxi4Fm1QwmopCGWl623NczwROHfH8EjkHAOoTyvMVTF3ZQ==',key_name='tempest-keypair-1121072342',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90a6d95b1ed43879eca5e07be0a4276',ramdisk_id='',reservation_id='r-qf2vl9ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1052742553',owner_user_name='tempest-AttachVolumeShelveTestJSON-1052742553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a31aeeca154620ba74acbaaabcdced',uuid=a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converting VIF {"id": "fdbd9421-e567-4b3a-bd7b-442868a99815", "address": "fa:16:3e:2f:9b:10", "network": {"id": "0226213d-fe24-4326-b280-2c470930a499", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1420815431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90a6d95b1ed43879eca5e07be0a4276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdbd9421-e5", "ovs_interfaceid": "fdbd9421-e567-4b3a-bd7b-442868a99815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG os_vif [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdbd9421-e5, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f4109d8-672f-4c62-b4a5-622f7574b059) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:51 user nova-compute[75340]: INFO os_vif [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=fdbd9421-e567-4b3a-bd7b-442868a99815,network=Network(0226213d-fe24-4326-b280-2c470930a499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdbd9421-e5')
Nov 30 09:44:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Deleting instance files /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7_del
Nov 30 09:44:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Deletion of /opt/stack/data/nova/instances/a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7_del complete
Nov 30 09:44:51 user nova-compute[75340]: INFO nova.compute.manager [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 09:44:51 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:51 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:44:52 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Took 0.67 seconds to deallocate network for instance.
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-1a9b9f40-7e29-4817-ba24-629f547e1d46 req-64b5de53-b3dc-4829-9792-e6143a777ca6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-deleted-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:52 user nova-compute[75340]: INFO nova.compute.manager [req-1a9b9f40-7e29-4817-ba24-629f547e1d46 req-64b5de53-b3dc-4829-9792-e6143a777ca6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Neutron deleted interface fdbd9421-e567-4b3a-bd7b-442868a99815; detaching it from the instance and deleting it from the info cache
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.network.neutron [req-1a9b9f40-7e29-4817-ba24-629f547e1d46 req-64b5de53-b3dc-4829-9792-e6143a777ca6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.compute.manager [req-1a9b9f40-7e29-4817-ba24-629f547e1d46 req-64b5de53-b3dc-4829-9792-e6143a777ca6 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Detach interface failed, port_id=fdbd9421-e567-4b3a-bd7b-442868a99815, reason: Instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:44:52 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Creating image(s)
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Ensure instance console log exists: /opt/stack/data/nova/instances/377565ea-54aa-4a3c-a0f7-8ed33125469f/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Start _get_guest_xml network_info=[{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c572cb48-3a9c-4d53-8030-254cf691b388', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '377565ea-54aa-4a3c-a0f7-8ed33125469f', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'serial': 'b1ad606b-7ebf-4ce0-afa6-3e55248cfe63'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:44:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:44:52 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:44:52 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:44:52 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:44:52 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:44:52 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Deleted allocations for instance a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e34c8-ed4d-4655-9a86-0a0545c9a8ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:44:52 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f335a-2a1a-4a93-b5c3-840506b4fbcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63] added
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[accbb1f8-b2de-4881-b298-e56f329222eb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ba19a2bb-7c7d-4a7f-88b4-912fac4353ac tempest-AttachVolumeShelveTestJSON-1052742553 tempest-AttachVolumeShelveTestJSON-1052742553-project-member] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989ac0a-da2f-4955-82f1-cddaaff45f4e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJSgFlZQ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJSgFlZQ" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[801843a1-95c8-46ad-822e-fd8d943bcd62]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EJSgFlZQ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf0408-1c91-4216-a9c9-291d9c962c10]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d780a7a-cf89-47bd-89df-691534d5bf3e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b10d7-d6df-4880-a90d-e537be43762e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]
Nov 30 09:44:52 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd4809-3d27-4482-b9c8-e8e38349f31c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a563d8-18e6-4cac-b5ca-2842a4e9a3e3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:44:52 user nova-compute[75340]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:44:52 user nova-compute[75340]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:44:52 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dab291-7b95-462d-906d-5ae42a047c06]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:44:52 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] Acquiring lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] Lock "a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.compute.manager [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] No waiting events found dispatching network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:44:53 user nova-compute[75340]: WARNING nova.compute.manager [req-53cfc25b-0dcd-4d92-b920-730f79eaa243 req-782256c6-cba1-4975-97ca-8a264ae22852 service nova] [instance: a7cc100e-49aa-4ab3-9dd7-d7aeb5ec96d7] Received unexpected event network-vif-plugged-fdbd9421-e567-4b3a-bd7b-442868a99815 for instance with vm_state deleted and task_state None.
Nov 30 09:44:53 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23139373330366639', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139373330366639', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288527486',display_name='tempest-TestVolumeBootPattern-server-1288527486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288527486',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-d1hm4ev9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:44:43Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=377565ea-54aa-4a3c-a0f7-8ed33125469f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.objects.instance [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid 377565ea-54aa-4a3c-a0f7-8ed33125469f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:44:53 user nova-compute[75340]:   <uuid>377565ea-54aa-4a3c-a0f7-8ed33125469f</uuid>
Nov 30 09:44:53 user nova-compute[75340]:   <name>instance-00000031</name>
Nov 30 09:44:53 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:44:53 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:44:53 user nova-compute[75340]:   <metadata>
Nov 30 09:44:53 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:44:53 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:44:53 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-server-1288527486</nova:name>
Nov 30 09:44:53 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:44:52</nova:creationTime>
Nov 30 09:44:53 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:44:53 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:44:53 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:44:53 user nova-compute[75340]:       <nova:owner>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:44:53 user nova-compute[75340]:       </nova:owner>
Nov 30 09:44:53 user nova-compute[75340]:       <nova:ports>
Nov 30 09:44:53 user nova-compute[75340]:         <nova:port uuid="ad923f21-53c9-4b42-865f-7afaf123cf55">
Nov 30 09:44:53 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 09:44:53 user nova-compute[75340]:         </nova:port>
Nov 30 09:44:53 user nova-compute[75340]:       </nova:ports>
Nov 30 09:44:53 user nova-compute[75340]:     </nova:instance>
Nov 30 09:44:53 user nova-compute[75340]:   </metadata>
Nov 30 09:44:53 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:44:53 user nova-compute[75340]:     <system>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="serial">377565ea-54aa-4a3c-a0f7-8ed33125469f</entry>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="uuid">377565ea-54aa-4a3c-a0f7-8ed33125469f</entry>
Nov 30 09:44:53 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:44:53 user nova-compute[75340]:     </system>
Nov 30 09:44:53 user nova-compute[75340]:   </sysinfo>
Nov 30 09:44:53 user nova-compute[75340]:   <os>
Nov 30 09:44:53 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:44:53 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:44:53 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:44:53 user nova-compute[75340]:   </os>
Nov 30 09:44:53 user nova-compute[75340]:   <features>
Nov 30 09:44:53 user nova-compute[75340]:     <acpi/>
Nov 30 09:44:53 user nova-compute[75340]:     <apic/>
Nov 30 09:44:53 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:44:53 user nova-compute[75340]:   </features>
Nov 30 09:44:53 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:44:53 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:44:53 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:44:53 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:44:53 user nova-compute[75340]:   </clock>
Nov 30 09:44:53 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:44:53 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:44:53 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:44:53 user nova-compute[75340]:   </cpu>
Nov 30 09:44:53 user nova-compute[75340]:   <devices>
Nov 30 09:44:53 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:44:53 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:44:53 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:44:53 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:44:53 user nova-compute[75340]:       <serial>b1ad606b-7ebf-4ce0-afa6-3e55248cfe63</serial>
Nov 30 09:44:53 user nova-compute[75340]:     </disk>
Nov 30 09:44:53 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:44:53 user nova-compute[75340]:       <mac address="fa:16:3e:3e:c7:43"/>
Nov 30 09:44:53 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:44:53 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:44:53 user nova-compute[75340]:       <target dev="tapad923f21-53"/>
Nov 30 09:44:53 user nova-compute[75340]:     </interface>
Nov 30 09:44:53 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:44:53 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/377565ea-54aa-4a3c-a0f7-8ed33125469f/console.log" append="off"/>
Nov 30 09:44:53 user nova-compute[75340]:     </serial>
Nov 30 09:44:53 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:44:53 user nova-compute[75340]:     <video>
Nov 30 09:44:53 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:44:53 user nova-compute[75340]:     </video>
Nov 30 09:44:53 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:44:53 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:44:53 user nova-compute[75340]:     </rng>
Nov 30 09:44:53 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:44:53 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:44:53 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:44:53 user nova-compute[75340]:     </memballoon>
Nov 30 09:44:53 user nova-compute[75340]:   </devices>
Nov 30 09:44:53 user nova-compute[75340]: </domain>
Nov 30 09:44:53 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288527486',display_name='tempest-TestVolumeBootPattern-server-1288527486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288527486',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-d1hm4ev9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:44:43Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=377565ea-54aa-4a3c-a0f7-8ed33125469f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG os_vif [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '694e11de-4d11-5d94-acc2-2f800a2309c2', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad923f21-53, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad923f21-53, col_values=(('qos', UUID('0b59c254-3675-40b7-a2ca-0efc0c88a2df')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad923f21-53, col_values=(('external_ids', {'iface-id': 'ad923f21-53c9-4b42-865f-7afaf123cf55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:c7:43', 'vm-uuid': '377565ea-54aa-4a3c-a0f7-8ed33125469f'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:53 user nova-compute[75340]: INFO os_vif [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53')
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:44:53 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:3e:c7:43, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:44:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG nova.compute.manager [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] No waiting events found dispatching network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:44:55 user nova-compute[75340]: WARNING nova.compute.manager [req-67dc686d-a522-47c7-833e-54cbef3f4f7d req-8702c182-1732-4f94-9aec-90a7c6edd18d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received unexpected event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 for instance with vm_state building and task_state spawning.
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:44:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Instance spawned successfully.
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:44:57 user nova-compute[75340]: INFO nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:44:57 user nova-compute[75340]: INFO nova.compute.manager [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Took 14.73 seconds to build instance.
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG nova.compute.manager [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] No waiting events found dispatching network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:44:57 user nova-compute[75340]: WARNING nova.compute.manager [req-b4a628ef-a754-4f67-96f7-6316682a2a16 req-6efa65c5-6fc7-402d-be72-54c9bbd0e152 service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received unexpected event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 for instance with vm_state active and task_state None.
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-b86bf13c-3206-4099-ac53-da81a47f74ad tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.824s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:44:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:44:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:45:01 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:45:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:45:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:45:03 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.117572784423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 377565ea-54aa-4a3c-a0f7-8ed33125469f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:45:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:45:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:45:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:45:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:45:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing instance network info cache due to event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated VIF entry in instance network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:45:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-ab8bb593-7fa6-41d5-b5d5-3a1f32205e3a req-8d99aa79-df0e-4e2b-bbd0-937cbd7364c5 service nova] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing instance network info cache due to event network-changed-64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] Acquiring lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] Acquired lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Refreshing network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:45:41 user nova-compute[75340]: INFO nova.compute.manager [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Detaching volume a8123acb-62a6-4628-83ee-475202bf565c
Nov 30 09:45:41 user nova-compute[75340]: INFO nova.virt.block_device [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Attempting to driver detach volume a8123acb-62a6-4628-83ee-475202bf565c from mountpoint /dev/vdb
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Attempting to detach device vdb from instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:45:41 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:45:41 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:45:41 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:45:41 user nova-compute[75340]:   <serial>a8123acb-62a6-4628-83ee-475202bf565c</serial>
Nov 30 09:45:41 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:45:41 user nova-compute[75340]: </disk>
Nov 30 09:45:41 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:45:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully detached device vdb from instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 from the persistent domain config.
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:45:41 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:45:41 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:45:41 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:45:41 user nova-compute[75340]:   <serial>a8123acb-62a6-4628-83ee-475202bf565c</serial>
Nov 30 09:45:41 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:45:41 user nova-compute[75340]: </disk>
Nov 30 09:45:41 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updated VIF entry in instance network info cache for port 64a8813a-a6d2-439c-a76d-fe5f04853a8c. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.network.neutron [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [{"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-af19df86-8941-40bc-b0de-006375b58667 req-9b468204-91cd-4255-91fa-841a55fb2c6e service nova] Releasing lock "refresh_cache-fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:45:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:45:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:45:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:57 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:45:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:45:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:01 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 is timed out.
Nov 30 09:46:01 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully detached device vdb from instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 from the live domain config.
Nov 30 09:46:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZraLONXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:46:01 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:46:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:46:01 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c147042b-7b1b-4870-8ecf-ec91fa3fecbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:46:02 user nova-compute[75340]: No targets found.
Nov 30 09:46:02 user nova-compute[75340]: iSNS:
Nov 30 09:46:02 user nova-compute[75340]: No targets found.
Nov 30 09:46:02 user nova-compute[75340]: STATIC:
Nov 30 09:46:02 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c
Nov 30 09:46:02 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:46:02 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:46:02 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63
Nov 30 09:46:02 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:46:02 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:46:02 user nova-compute[75340]: FIRMWARE:
Nov 30 09:46:02 user nova-compute[75340]: No targets found.
Nov 30 09:46:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:46:02 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:46:02 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3918c4c4-9139-4e25-8f3b-5dd986d765b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad5e6f-676c-40c6-bc30-8dba7b8c0c31]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:46:02 user nova-compute[75340]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:46:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c (non-flash)
Nov 30 09:46:02 user nova-compute[75340]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:46:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307e8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0bef29-82e9-45d8-9d90-d39bec90378b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3458a3-ea97-4ff1-b999-3f7264be8c3c]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[78219422-fd2f-489e-b6a4-9645e976c415]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4d153-7193-44a8-befe-f042d893eb3b]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[792af217-d751-4414-a3fd-dc022eb29d2d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3c124-5dca-400b-bc6d-9698a0cd2412]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260]
Nov 30 09:46:02 user nova-compute[75340]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c, portal: 172.16.0.220,3260] successful.
Nov 30 09:46:02 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8123acb-62a6-4628-83ee-475202bf565c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e2017-b670-4ac3-a57d-830b44d0c231]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] <== disconnect_volume: return (315ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:46:02 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:46:02 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.11609649658203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 377565ea-54aa-4a3c-a0f7-8ed33125469f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:46:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:03 user nova-compute[75340]: DEBUG nova.objects.instance [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'flavor' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:46:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-fc314d55-7951-4351-8d43-f373b56e6b48 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating instance_info_cache with network_info: [{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:46:04 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:46:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-changed-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.compute.manager [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Refreshing instance network info cache due to event network-changed-ad923f21-53c9-4b42-865f-7afaf123cf55. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] Acquiring lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] Acquired lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Refreshing network info cache for port ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updated VIF entry in instance network info cache for port ad923f21-53c9-4b42-865f-7afaf123cf55. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.network.neutron [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating instance_info_cache with network_info: [{"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2bb891a3-ce62-4bf8-802b-29bfe606341d req-23d58879-6503-4e1c-9256-c4de7129272d service nova] Releasing lock "refresh_cache-377565ea-54aa-4a3c-a0f7-8ed33125469f" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:35 user nova-compute[75340]: INFO nova.compute.manager [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Terminating instance
Nov 30 09:46:35 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-unplugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] No waiting events found dispatching network-vif-unplugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.compute.manager [req-56a836bd-a923-467e-8786-30475f9fa682 req-3ca90fc4-3cf5-4f92-9701-c97981a5824c service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-unplugged-ad923f21-53c9-4b42-865f-7afaf123cf55 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Instance destroyed successfully.
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid 377565ea-54aa-4a3c-a0f7-8ed33125469f {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288527486',display_name='tempest-TestVolumeBootPattern-server-1288527486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288527486',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:44:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-d1hm4ev9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:44:57Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=377565ea-54aa-4a3c-a0f7-8ed33125469f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "ad923f21-53c9-4b42-865f-7afaf123cf55", "address": "fa:16:3e:3e:c7:43", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad923f21-53", "ovs_interfaceid": "ad923f21-53c9-4b42-865f-7afaf123cf55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_vif [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad923f21-53, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b59c254-3675-40b7-a2ca-0efc0c88a2df) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:36 user nova-compute[75340]: INFO os_vif [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c7:43,bridge_name='br-int',has_traffic_filtering=True,id=ad923f21-53c9-4b42-865f-7afaf123cf55,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad923f21-53')
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:46:36 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5809609-1227-47a3-b6b5-d5bada180a85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:46:36 user nova-compute[75340]: No targets found.
Nov 30 09:46:36 user nova-compute[75340]: iSNS:
Nov 30 09:46:36 user nova-compute[75340]: No targets found.
Nov 30 09:46:36 user nova-compute[75340]: STATIC:
Nov 30 09:46:36 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63
Nov 30 09:46:36 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:46:36 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:46:36 user nova-compute[75340]: FIRMWARE:
Nov 30 09:46:36 user nova-compute[75340]: No targets found.
Nov 30 09:46:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:46:36 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:46:36 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[060be040-dee0-4dd9-b218-7cf2d339c982]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f158e9-fcd1-44a3-b3a5-5b6751a770ce]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:46:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:46:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305a4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df7e283-3f65-451a-8dad-c12134f7e531]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9271c2b1-36d2-45c5-b498-91d67289c895]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54d6280-fec4-406e-b3ba-c8d2462d1928]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbe164-39a8-4ba0-8423-9d01420d618b]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3487235-197306f9b418b84a', '/dev/disk/by-id/scsi-23139373330366639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3487235') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce07296-7875-49f3-905b-aaa844777b3d]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08bc9df-83f9-4019-957e-7a2cd52b319c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6afde9-a9b2-46f7-b027-433211f74595]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]
Nov 30 09:46:36 user nova-compute[75340]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.
Nov 30 09:46:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[427dc2cf-82da-472e-b14e-69a01e63c798]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (327ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:46:36 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Deleting instance files /opt/stack/data/nova/instances/377565ea-54aa-4a3c-a0f7-8ed33125469f_del
Nov 30 09:46:36 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Deletion of /opt/stack/data/nova/instances/377565ea-54aa-4a3c-a0f7-8ed33125469f_del complete
Nov 30 09:46:36 user nova-compute[75340]: INFO nova.compute.manager [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 30 09:46:36 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:46:36 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:46:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] Acquiring lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] No waiting events found dispatching network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:46:38 user nova-compute[75340]: WARNING nova.compute.manager [req-bde8ddf7-adaa-4426-ad08-bcc14fbfc23f req-03cb96bf-929c-4c21-b3ef-6aa63628726a service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received unexpected event network-vif-plugged-ad923f21-53c9-4b42-865f-7afaf123cf55 for instance with vm_state active and task_state deleting.
Nov 30 09:46:38 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:46:38 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Took 1.29 seconds to deallocate network for instance.
Nov 30 09:46:38 user nova-compute[75340]: DEBUG nova.compute.manager [req-ec0091de-f385-4a67-ab93-a37f7db4914c req-4e7092b7-af2f-453c-ad73-c5c25da544fa service nova] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Received event network-vif-deleted-ad923f21-53c9-4b42-865f-7afaf123cf55 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:39 user nova-compute[75340]: INFO nova.compute.manager [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Terminating instance
Nov 30 09:46:39 user nova-compute[75340]: DEBUG nova.compute.manager [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Instance destroyed successfully.
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lazy-loading 'resources' on Instance uuid fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1060269847',display_name='tempest-TestMinimumBasicScenario-server-1060269847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1060269847',id=48,image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuT+WdPAULx3tTvlMEFbVVUolKGIEjdNvoV9LvVNGRcmwKyOB5ebfkgXUxKqp8r43MOJI6xUjm3ZqS0Yt11EZk4c3JVpOk1eFZ3o1TMwAdx64JpiVZRhxMYURJtNpHheA==',key_name='tempest-TestMinimumBasicScenario-459010262',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c44e90da98479fb459142c4acb01ea',ramdisk_id='',reservation_id='r-i20zfqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2cd67e-895f-47ad-b5aa-9f6824c56b4b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-627001043',owner_user_name='tempest-TestMinimumBasicScenario-627001043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:43:55Z,user_data=None,user_id='0bbb4a25e58849c89e71d22727b082b7',uuid=fe25a6bb-c3c7-43ab-a09e-7f2d3003c774,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converting VIF {"id": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "address": "fa:16:3e:71:79:fd", "network": {"id": "96f80a7a-c9d5-4209-82e2-a917db001531", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2099173254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c44e90da98479fb459142c4acb01ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8813a-a6", "ovs_interfaceid": "64a8813a-a6d2-439c-a76d-fe5f04853a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG os_vif [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a8813a-a6, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fea5311-b724-4c41-a28f-3b29e4167591) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:40 user nova-compute[75340]: INFO os_vif [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:79:fd,bridge_name='br-int',has_traffic_filtering=True,id=64a8813a-a6d2-439c-a76d-fe5f04853a8c,network=Network(96f80a7a-c9d5-4209-82e2-a917db001531),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a8813a-a6')
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Deleting instance files /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774_del
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Deletion of /opt/stack/data/nova/instances/fe25a6bb-c3c7-43ab-a09e-7f2d3003c774_del complete
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-95421a74-9658-429b-9792-c42d67ac7f19 req-fc423c4d-c8e2-48f0-82a3-0091a91b895e service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-unplugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.compute.manager [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 09:46:40 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Took 0.67 seconds to deallocate network for instance.
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-d749ea29-dd96-4116-9da6-516db898053e req-75104f3e-2cd8-418f-b7eb-f18488c90403 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-deleted-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:40 user nova-compute[75340]: INFO nova.compute.manager [req-d749ea29-dd96-4116-9da6-516db898053e req-75104f3e-2cd8-418f-b7eb-f18488c90403 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Neutron deleted interface 64a8813a-a6d2-439c-a76d-fe5f04853a8c; detaching it from the instance and deleting it from the info cache
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.network.neutron [req-d749ea29-dd96-4116-9da6-516db898053e req-75104f3e-2cd8-418f-b7eb-f18488c90403 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:46:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-d749ea29-dd96-4116-9da6-516db898053e req-75104f3e-2cd8-418f-b7eb-f18488c90403 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Detach interface failed, port_id=64a8813a-a6d2-439c-a76d-fe5f04853a8c, reason: Instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774 could not be found. {{(pid=75340) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:41 user nova-compute[75340]: INFO nova.compute.manager [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 377565ea-54aa-4a3c-a0f7-8ed33125469f] Took 2.90 seconds to detach 1 volumes for instance.
Nov 30 09:46:41 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.036s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:41 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Deleted allocations for instance fe25a6bb-c3c7-43ab-a09e-7f2d3003c774
Nov 30 09:46:41 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c741facb-01a5-4660-aaa9-3a5c88a5a2a9 tempest-TestMinimumBasicScenario-627001043 tempest-TestMinimumBasicScenario-627001043-project-member] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.034s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:41 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance 377565ea-54aa-4a3c-a0f7-8ed33125469f
Nov 30 09:46:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e4a05bca-3a9f-45af-aa2c-5fe14843bd67 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "377565ea-54aa-4a3c-a0f7-8ed33125469f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.773s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:46:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] Acquiring lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:46:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:46:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] Lock "fe25a6bb-c3c7-43ab-a09e-7f2d3003c774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:46:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] No waiting events found dispatching network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:46:42 user nova-compute[75340]: WARNING nova.compute.manager [req-d04bf1fd-46ce-42b9-b8c5-096daf802476 req-61b887bd-0008-41df-9dcd-85229b3df724 service nova] [instance: fe25a6bb-c3c7-43ab-a09e-7f2d3003c774] Received unexpected event network-vif-plugged-64a8813a-a6d2-439c-a76d-fe5f04853a8c for instance with vm_state deleted and task_state None.
Nov 30 09:46:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:46:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:46:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:46:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:46:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:47:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:47:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.133087158203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:47:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:47:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:47:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:47:27 user nova-compute[75340]: INFO nova.compute.claims [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Claim successful on node user
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:47:27 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:47:28 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:47:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG nova.policy [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:47:28 user nova-compute[75340]: INFO nova.virt.block_device [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Booting with volume b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 at /dev/vda
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.utils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f2bc1-b672-4d3d-8d51-63ad159b4f96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79f4fe-9e8e-4c2c-b57c-c0de4ca763c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b1530f-0fb7-4d19-9877-d4549be01fac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b330f-09c0-41a7-b0df-2b20062ba21f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:47:28 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:47:28 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b215ea5d-83ce-461f-99c0-05515d9ff8c3]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG os_brick.utils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating existing volume attachment record: 614523ff-417a-4ff0-98cb-ba5139b8a11f {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:47:28 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Successfully created port: fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Successfully updated port: fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.compute.manager [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing instance network info cache due to event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Instance network_info: |[{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:47:29 user nova-compute[75340]: DEBUG nova.network.neutron [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:47:30 user nova-compute[75340]: DEBUG nova.network.neutron [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated VIF entry in instance network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:47:30 user nova-compute[75340]: DEBUG nova.network.neutron [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:47:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-476926a8-bef3-4a02-b9a0-6546c2ae42f6 req-c2481d6d-2e38-4d50-8f87-36d4244a5aac service nova] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:47:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:47:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Creating image(s)
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Ensure instance console log exists: /opt/stack/data/nova/instances/8f535bfb-4ab4-4746-be3f-ff81f8c61d08/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Start _get_guest_xml network_info=[{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '614523ff-417a-4ff0-98cb-ba5139b8a11f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f535bfb-4ab4-4746-be3f-ff81f8c61d08', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'serial': 'b1ad606b-7ebf-4ce0-afa6-3e55248cfe63'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:47:37 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:47:37 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:47:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:47:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:47:37 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be35375d-847d-46fb-9eb5-fda1a484efae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:47:37 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70779e21-9ae3-4f58-940c-8e0f48e31f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63] added
Nov 30 09:47:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e45b17-d83c-4444-8693-d6faedc6be9e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaebd94-ff5c-470b-b083-191a69770a58]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJSgFlZQ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJSgFlZQ" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12410f6-e5f8-499d-b545-1d8a5d82b806]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EJSgFlZQ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34f94fb-51f0-44b0-a559-4109d571efbf]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b88366-42cb-43a6-804c-941653490d9b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:47:37 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:47:37 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:47:37 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:47:37 user nova-compute[75340]: 
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fdce5-e07d-4e9b-a2ca-279b9545453e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]
Nov 30 09:47:37 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.
Nov 30 09:47:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40502a0-2a93-4be8-b47b-80adf1292e6d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f980fa2-fa0b-417d-830d-72f884db372e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:47:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:47:37 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[975eaa6b-d53f-464e-a041-091bb101eaf2]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:47:37 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23139373330366639', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139373330366639', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1038879179',display_name='tempest-TestVolumeBootPattern-server-1038879179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1038879179',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-wcbmgj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:47:28Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8f535bfb-4ab4-4746-be3f-ff81f8c61d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.objects.instance [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:47:38 user nova-compute[75340]:   <uuid>8f535bfb-4ab4-4746-be3f-ff81f8c61d08</uuid>
Nov 30 09:47:38 user nova-compute[75340]:   <name>instance-00000032</name>
Nov 30 09:47:38 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:47:38 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:47:38 user nova-compute[75340]:   <metadata>
Nov 30 09:47:38 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:47:38 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:47:38 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-server-1038879179</nova:name>
Nov 30 09:47:38 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:47:37</nova:creationTime>
Nov 30 09:47:38 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:47:38 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:47:38 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:47:38 user nova-compute[75340]:       <nova:owner>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:47:38 user nova-compute[75340]:       </nova:owner>
Nov 30 09:47:38 user nova-compute[75340]:       <nova:ports>
Nov 30 09:47:38 user nova-compute[75340]:         <nova:port uuid="fa55fd8d-a269-4989-ad6f-bd8b5629b393">
Nov 30 09:47:38 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 09:47:38 user nova-compute[75340]:         </nova:port>
Nov 30 09:47:38 user nova-compute[75340]:       </nova:ports>
Nov 30 09:47:38 user nova-compute[75340]:     </nova:instance>
Nov 30 09:47:38 user nova-compute[75340]:   </metadata>
Nov 30 09:47:38 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:47:38 user nova-compute[75340]:     <system>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="serial">8f535bfb-4ab4-4746-be3f-ff81f8c61d08</entry>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="uuid">8f535bfb-4ab4-4746-be3f-ff81f8c61d08</entry>
Nov 30 09:47:38 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:47:38 user nova-compute[75340]:     </system>
Nov 30 09:47:38 user nova-compute[75340]:   </sysinfo>
Nov 30 09:47:38 user nova-compute[75340]:   <os>
Nov 30 09:47:38 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:47:38 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:47:38 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:47:38 user nova-compute[75340]:   </os>
Nov 30 09:47:38 user nova-compute[75340]:   <features>
Nov 30 09:47:38 user nova-compute[75340]:     <acpi/>
Nov 30 09:47:38 user nova-compute[75340]:     <apic/>
Nov 30 09:47:38 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:47:38 user nova-compute[75340]:   </features>
Nov 30 09:47:38 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:47:38 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:47:38 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:47:38 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:47:38 user nova-compute[75340]:   </clock>
Nov 30 09:47:38 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:47:38 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:47:38 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:47:38 user nova-compute[75340]:   </cpu>
Nov 30 09:47:38 user nova-compute[75340]:   <devices>
Nov 30 09:47:38 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:47:38 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:47:38 user nova-compute[75340]:       <source dev="/dev/sdb"/>
Nov 30 09:47:38 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:47:38 user nova-compute[75340]:       <serial>b1ad606b-7ebf-4ce0-afa6-3e55248cfe63</serial>
Nov 30 09:47:38 user nova-compute[75340]:     </disk>
Nov 30 09:47:38 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:47:38 user nova-compute[75340]:       <mac address="fa:16:3e:4a:f8:ae"/>
Nov 30 09:47:38 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:47:38 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:47:38 user nova-compute[75340]:       <target dev="tapfa55fd8d-a2"/>
Nov 30 09:47:38 user nova-compute[75340]:     </interface>
Nov 30 09:47:38 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:47:38 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/8f535bfb-4ab4-4746-be3f-ff81f8c61d08/console.log" append="off"/>
Nov 30 09:47:38 user nova-compute[75340]:     </serial>
Nov 30 09:47:38 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:47:38 user nova-compute[75340]:     <video>
Nov 30 09:47:38 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:47:38 user nova-compute[75340]:     </video>
Nov 30 09:47:38 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:47:38 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:47:38 user nova-compute[75340]:     </rng>
Nov 30 09:47:38 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:47:38 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:47:38 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:47:38 user nova-compute[75340]:     </memballoon>
Nov 30 09:47:38 user nova-compute[75340]:   </devices>
Nov 30 09:47:38 user nova-compute[75340]: </domain>
Nov 30 09:47:38 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1038879179',display_name='tempest-TestVolumeBootPattern-server-1038879179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1038879179',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-wcbmgj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:47:28Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8f535bfb-4ab4-4746-be3f-ff81f8c61d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG os_vif [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6e1e554-b031-5eaa-bc49-726053d467c1', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa55fd8d-a2, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa55fd8d-a2, col_values=(('qos', UUID('cdd91cfc-90ae-49fc-b1fa-9a18f4d9c6c4')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa55fd8d-a2, col_values=(('external_ids', {'iface-id': 'fa55fd8d-a269-4989-ad6f-bd8b5629b393', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f8:ae', 'vm-uuid': '8f535bfb-4ab4-4746-be3f-ff81f8c61d08'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:38 user nova-compute[75340]: INFO os_vif [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2')
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:47:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:4a:f8:ae, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:47:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG nova.compute.manager [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] No waiting events found dispatching network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:47:40 user nova-compute[75340]: WARNING nova.compute.manager [req-55800c9b-c3cf-425f-b44f-151f7073a0f2 req-68a440cb-93d6-43bc-baf1-54d3787c8b17 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received unexpected event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 for instance with vm_state building and task_state spawning.
Nov 30 09:47:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:47:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:47:41 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Instance spawned successfully.
Nov 30 09:47:41 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:47:42 user nova-compute[75340]: INFO nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:42 user nova-compute[75340]: DEBUG nova.compute.manager [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] No waiting events found dispatching network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:47:42 user nova-compute[75340]: WARNING nova.compute.manager [req-accd4f27-db24-40e2-9f67-6d2e8f1dae1d req-9c773183-a5c5-46ec-88bc-17088fa57b49 service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received unexpected event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 for instance with vm_state building and task_state spawning.
Nov 30 09:47:42 user nova-compute[75340]: INFO nova.compute.manager [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Took 14.47 seconds to build instance.
Nov 30 09:47:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-27b74b20-f8a9-4e49-9239-85ccd4e03ef7 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.566s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:47:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:47:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:54 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:47:54 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:47:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:47:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:47:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:48:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:48:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:48:04 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.17072296142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:48:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:48:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:48:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:48:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:48:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:48:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:48:56 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:48:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:48:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:49:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:49:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:49:05 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:49:05 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.17009735107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:49:05 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:49:07 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:49:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG nova.compute.manager [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing instance network info cache due to event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated VIF entry in instance network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG nova.network.neutron [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:49:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f7c2b784-f218-4818-9688-d6be55ab01f3 req-b352f585-c318-4a58-ae42-7caa98c779ef service nova] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:49:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Verify base images {{(pid=75340) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75340) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 is a valid instance name {{(pid=75340) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a
Nov 30 09:49:28 user nova-compute[75340]: WARNING nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Unknown base file: /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Removable base files: /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651 /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4 /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0 /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41 /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/215d2ca87b8bb5714859a59c28d8e1cb35981651
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eef2f1a54bf6f8d5ffff1c0442a185a97b900f0c
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1022ca467ee8ac6178138b27d4c6f58fc02535e4
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/670783bcc132813059ef65f8db89ecd5862e3ef0
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/096d322eac7c157fcb742cf6b2a10e154cb70d41
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05bee06a152ef3b0bcf4498f6ac30d47d193056e
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dcfb8913d5a84b38b73cfb69518dca2b35ba7ccb
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba06f4d92d6be6cd7a0534492459435756dd825a
Nov 30 09:49:28 user nova-compute[75340]: INFO nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83602ae0fcb9610d139b826ce234739a483d325d
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Verification complete {{(pid=75340) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Verify swap images {{(pid=75340) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.imagecache [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Verify ephemeral images {{(pid=75340) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:28 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:49:29 user nova-compute[75340]: INFO nova.compute.claims [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Claim successful on node user
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:49:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.policy [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e85e448fe394ce1a7775cde196d0fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44adf4b9fd2b47559a452ee5d13876e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:49:29 user nova-compute[75340]: INFO nova.virt.block_device [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Booting with volume 425360d8-7200-4827-b528-fbe32d93cddb at /dev/vda
Nov 30 09:49:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.utils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded2913-aeef-4be0-906e-4971c18a0fae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408ac83-a95c-40c9-bd65-8db03791c01c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd8424-47bd-414f-977f-dc86aee59a11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9668cb-170f-4102-8385-2b9ab7a1d795]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:49:29 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:49:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7232668-a20e-4b9a-b19d-7469db0c3408]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG os_brick.utils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:49:29 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating existing volume attachment record: 8ed20a1a-c8fe-4ae4-b75a-5d94147085de {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:49:30 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Successfully created port: 6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Successfully updated port: 6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquired lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.compute.manager [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing instance network info cache due to event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] Acquiring lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Releasing lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Instance network_info: |[{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] Acquired lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updated VIF entry in instance network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG nova.network.neutron [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:49:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-007eb04b-7a7f-47ac-8e5f-efe0349719ae req-7a9a4a84-a5a3-4764-97f5-53930c9f7b25 service nova] Releasing lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:49:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:49:38 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Creating image(s)
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Did not create local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Ensure instance console log exists: /opt/stack/data/nova/instances/5835c857-b74a-4a93-a6c5-55280540efa7/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Start _get_guest_xml network_info=[{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8ed20a1a-c8fe-4ae4-b75a-5d94147085de', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wznlBMmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5835c857-b74a-4a93-a6c5-55280540efa7', 'attached_at': '', 'detached_at': '', 'volume_id': '425360d8-7200-4827-b528-fbe32d93cddb', 'serial': '425360d8-7200-4827-b528-fbe32d93cddb'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:49:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:49:38 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wznlBMmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:49:38 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:49:38 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:49:38 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc7dc1-9feb-4dcf-ba77-8b22b50009b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:49:38 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326c8f1-78d8-4b7d-a899-aa88975b18fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb] added
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8685876d-1dab-45da-a8cb-be77a0c87cc2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d472b-3bdc-44ff-8556-2a4b810a65e1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wznlBMmy {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wznlBMmy" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[be559394-44f6-4924-aeca-70f2327d40b4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wznlBMmy'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd9109d-20c8-43c2-b0fc-29765ea75fe1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ea1df-aefa-468d-a749-e4b64ed05224]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba37b2-54d0-4b48-9b64-e00ed08c8e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260]
Nov 30 09:49:38 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260] successful.
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab42ee5-467f-4a8f-a0aa-701e329130b9]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34126e3-4d70-41ec-985c-e6c7e1954250]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:49:38 user nova-compute[75340]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:49:38 user nova-compute[75340]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)
Nov 30 09:49:38 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b871e5-a58b-4bc9-bc30-7601d549c892]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:49:38 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wznlBMmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23336653861353761', 'path': '/dev/sdc'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336653861353761', 'path': '/dev/sdc'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-82532621',display_name='tempest-TestVolumeBootPattern-server-82532621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-82532621',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-3m69uuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:49:29Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=5835c857-b74a-4a93-a6c5-55280540efa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:49:39 user nova-compute[75340]: DEBUG nova.objects.instance [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'pci_devices' on Instance uuid 5835c857-b74a-4a93-a6c5-55280540efa7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:49:40 user nova-compute[75340]:   <uuid>5835c857-b74a-4a93-a6c5-55280540efa7</uuid>
Nov 30 09:49:40 user nova-compute[75340]:   <name>instance-00000033</name>
Nov 30 09:49:40 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:49:40 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:49:40 user nova-compute[75340]:   <metadata>
Nov 30 09:49:40 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:49:40 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:49:40 user nova-compute[75340]:       <nova:name>tempest-TestVolumeBootPattern-server-82532621</nova:name>
Nov 30 09:49:40 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:49:38</nova:creationTime>
Nov 30 09:49:40 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:49:40 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:49:40 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:49:40 user nova-compute[75340]:       <nova:owner>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:user uuid="5e85e448fe394ce1a7775cde196d0fb2">tempest-TestVolumeBootPattern-2091409042-project-member</nova:user>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:project uuid="44adf4b9fd2b47559a452ee5d13876e6">tempest-TestVolumeBootPattern-2091409042</nova:project>
Nov 30 09:49:40 user nova-compute[75340]:       </nova:owner>
Nov 30 09:49:40 user nova-compute[75340]:       <nova:ports>
Nov 30 09:49:40 user nova-compute[75340]:         <nova:port uuid="6a9b73ba-8ee1-403f-a580-9b6fe6225a46">
Nov 30 09:49:40 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 09:49:40 user nova-compute[75340]:         </nova:port>
Nov 30 09:49:40 user nova-compute[75340]:       </nova:ports>
Nov 30 09:49:40 user nova-compute[75340]:     </nova:instance>
Nov 30 09:49:40 user nova-compute[75340]:   </metadata>
Nov 30 09:49:40 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:49:40 user nova-compute[75340]:     <system>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="serial">5835c857-b74a-4a93-a6c5-55280540efa7</entry>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="uuid">5835c857-b74a-4a93-a6c5-55280540efa7</entry>
Nov 30 09:49:40 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:49:40 user nova-compute[75340]:     </system>
Nov 30 09:49:40 user nova-compute[75340]:   </sysinfo>
Nov 30 09:49:40 user nova-compute[75340]:   <os>
Nov 30 09:49:40 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:49:40 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:49:40 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:49:40 user nova-compute[75340]:   </os>
Nov 30 09:49:40 user nova-compute[75340]:   <features>
Nov 30 09:49:40 user nova-compute[75340]:     <acpi/>
Nov 30 09:49:40 user nova-compute[75340]:     <apic/>
Nov 30 09:49:40 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:49:40 user nova-compute[75340]:   </features>
Nov 30 09:49:40 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:49:40 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:49:40 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:49:40 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:49:40 user nova-compute[75340]:   </clock>
Nov 30 09:49:40 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:49:40 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:49:40 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:49:40 user nova-compute[75340]:   </cpu>
Nov 30 09:49:40 user nova-compute[75340]:   <devices>
Nov 30 09:49:40 user nova-compute[75340]:     <disk type="block" device="disk">
Nov 30 09:49:40 user nova-compute[75340]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:49:40 user nova-compute[75340]:       <source dev="/dev/sdc"/>
Nov 30 09:49:40 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:49:40 user nova-compute[75340]:       <serial>425360d8-7200-4827-b528-fbe32d93cddb</serial>
Nov 30 09:49:40 user nova-compute[75340]:     </disk>
Nov 30 09:49:40 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:49:40 user nova-compute[75340]:       <mac address="fa:16:3e:ca:f2:0a"/>
Nov 30 09:49:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:49:40 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:49:40 user nova-compute[75340]:       <target dev="tap6a9b73ba-8e"/>
Nov 30 09:49:40 user nova-compute[75340]:     </interface>
Nov 30 09:49:40 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:49:40 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/5835c857-b74a-4a93-a6c5-55280540efa7/console.log" append="off"/>
Nov 30 09:49:40 user nova-compute[75340]:     </serial>
Nov 30 09:49:40 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:49:40 user nova-compute[75340]:     <video>
Nov 30 09:49:40 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:49:40 user nova-compute[75340]:     </video>
Nov 30 09:49:40 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:49:40 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:49:40 user nova-compute[75340]:     </rng>
Nov 30 09:49:40 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:49:40 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:49:40 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:49:40 user nova-compute[75340]:     </memballoon>
Nov 30 09:49:40 user nova-compute[75340]:   </devices>
Nov 30 09:49:40 user nova-compute[75340]: </domain>
Nov 30 09:49:40 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-82532621',display_name='tempest-TestVolumeBootPattern-server-82532621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-82532621',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-3m69uuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:49:29Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=5835c857-b74a-4a93-a6c5-55280540efa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG os_vif [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f05cd8d1-9f49-5e6b-9da3-ffc6e922b664', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9b73ba-8e, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9b73ba-8e, col_values=(('qos', UUID('8d27eced-56a8-4019-98cf-de0951418f58')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9b73ba-8e, col_values=(('external_ids', {'iface-id': '6a9b73ba-8ee1-403f-a580-9b6fe6225a46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:f2:0a', 'vm-uuid': '5835c857-b74a-4a93-a6c5-55280540efa7'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:40 user nova-compute[75340]: INFO os_vif [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e')
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:49:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] No VIF found with MAC fa:16:3e:ca:f2:0a, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:41 user nova-compute[75340]: DEBUG nova.compute.manager [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] No waiting events found dispatching network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:49:41 user nova-compute[75340]: WARNING nova.compute.manager [req-b445a939-c7dd-4354-90d4-240ed737d20d req-ce7c9294-1345-46fb-be96-7eded822f35f service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received unexpected event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 for instance with vm_state building and task_state spawning.
Nov 30 09:49:41 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:49:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Instance spawned successfully.
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:49:43 user nova-compute[75340]: INFO nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] No waiting events found dispatching network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:49:43 user nova-compute[75340]: WARNING nova.compute.manager [req-67ac3ff3-eec3-4426-8daa-930506d85931 req-868218a2-3abe-4062-9f98-f403c299869e service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received unexpected event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 for instance with vm_state building and task_state spawning.
Nov 30 09:49:43 user nova-compute[75340]: INFO nova.compute.manager [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Took 14.62 seconds to build instance.
Nov 30 09:49:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-15e3b5f4-8141-4036-834c-2f25b4e0339e tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.724s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:49:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:49:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:49:58 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:49:58 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:49:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:50:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:50:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:50:07 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=25.16828155517578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:50:07 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 5835c857-b74a-4a93-a6c5-55280540efa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:50:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:50:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:50:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:27 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:50:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 5835c857-b74a-4a93-a6c5-55280540efa7 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:50:55 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:51:01 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:51:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:51:08 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:51:08 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=25.159847259521484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 5835c857-b74a-4a93-a6c5-55280540efa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:51:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:51:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:51:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:51:09 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:51:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing instance network info cache due to event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] Acquiring lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] Acquired lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updated VIF entry in instance network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:51:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-e3c294f0-14b4-455d-a6ee-5c3ae6436ea3 req-7a8ad90d-c825-4d43-aa5a-74c14f57d8d2 service nova] Releasing lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:22 user nova-compute[75340]: INFO nova.compute.manager [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Terminating instance
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-unplugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] No waiting events found dispatching network-vif-unplugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.compute.manager [req-5a1abd3e-59ec-4f6d-adf7-e0677edcab82 req-9de7acf5-92d2-43a4-a597-b2cab87c484a service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-unplugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Instance destroyed successfully.
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid 5835c857-b74a-4a93-a6c5-55280540efa7 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-82532621',display_name='tempest-TestVolumeBootPattern-server-82532621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-82532621',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-3m69uuya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:49:44Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=5835c857-b74a-4a93-a6c5-55280540efa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_vif [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9b73ba-8e, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d27eced-56a8-4019-98cf-de0951418f58) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:22 user nova-compute[75340]: INFO os_vif [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f2:0a,bridge_name='br-int',has_traffic_filtering=True,id=6a9b73ba-8ee1-403f-a580-9b6fe6225a46,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9b73ba-8e')
Nov 30 09:51:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wznlBMmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:51:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[565977e1-962a-4e2b-b1a2-2fdcf8b5ebcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:51:22 user nova-compute[75340]: No targets found.
Nov 30 09:51:22 user nova-compute[75340]: iSNS:
Nov 30 09:51:22 user nova-compute[75340]: No targets found.
Nov 30 09:51:22 user nova-compute[75340]: STATIC:
Nov 30 09:51:22 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb
Nov 30 09:51:22 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:51:22 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:51:22 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63
Nov 30 09:51:22 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:51:22 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:51:22 user nova-compute[75340]: FIRMWARE:
Nov 30 09:51:22 user nova-compute[75340]: No targets found.
Nov 30 09:51:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:51:22 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:51:22 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c0fa5-7fb8-4a0a-8610-160f17d86bd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[289938fa-d4b5-4408-a7e2-ec73fe066641]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:51:22 user nova-compute[75340]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)
Nov 30 09:51:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:51:22 user nova-compute[75340]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb (non-flash)
Nov 30 09:51:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305f5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb'): ({'sdc'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdc {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb94643-b6ac-4977-974b-56796171186e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[964de290-412b-4d50-b99f-472d539ecda0]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdc {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b35ed-52bb-4e65-9049-bd8aae84453c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ea26e-ecf3-4bdb-a73d-8149ce78a3c3]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdc have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9e419-8b48-4f52-8708-1431249d48ed]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing instance network info cache due to event network-changed-6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] Acquiring lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] Acquired lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Refreshing network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718edaa-edb3-431c-bd27-0330175fae7c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260]
Nov 30 09:51:23 user nova-compute[75340]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb, portal: 172.16.0.220,3260] successful.
Nov 30 09:51:23 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:425360d8-7200-4827-b528-fbe32d93cddb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[30945259-7fb7-4dfc-b4d1-9975ec9cfa0c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (298ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:51:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Deleting instance files /opt/stack/data/nova/instances/5835c857-b74a-4a93-a6c5-55280540efa7_del
Nov 30 09:51:23 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Deletion of /opt/stack/data/nova/instances/5835c857-b74a-4a93-a6c5-55280540efa7_del complete
Nov 30 09:51:23 user nova-compute[75340]: INFO nova.compute.manager [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updated VIF entry in instance network info cache for port 6a9b73ba-8ee1-403f-a580-9b6fe6225a46. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.network.neutron [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [{"id": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "address": "fa:16:3e:ca:f2:0a", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9b73ba-8e", "ovs_interfaceid": "6a9b73ba-8ee1-403f-a580-9b6fe6225a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-d0b57f11-2147-4010-8cef-2df4fcacefaf req-854f2919-5110-4b0d-9c3b-d4780a81b92d service nova] Releasing lock "refresh_cache-5835c857-b74a-4a93-a6c5-55280540efa7" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:51:23 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Took 0.52 seconds to deallocate network for instance.
Nov 30 09:51:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-eaf238bd-4341-4112-8262-dc772485ff60 req-b6227d55-c831-4094-bb29-46507c8e4657 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-deleted-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] Acquiring lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] Lock "5835c857-b74a-4a93-a6c5-55280540efa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG nova.compute.manager [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] No waiting events found dispatching network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:51:24 user nova-compute[75340]: WARNING nova.compute.manager [req-46406a2a-459f-4981-bbb0-2d437b57cc03 req-e5f05360-cf42-4c06-a15e-56bfd764fd97 service nova] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Received unexpected event network-vif-plugged-6a9b73ba-8ee1-403f-a580-9b6fe6225a46 for instance with vm_state active and task_state deleting.
Nov 30 09:51:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:24 user nova-compute[75340]: INFO nova.compute.manager [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 5835c857-b74a-4a93-a6c5-55280540efa7] Took 0.86 seconds to detach 1 volumes for instance.
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:24 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance 5835c857-b74a-4a93-a6c5-55280540efa7
Nov 30 09:51:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-e292aa2c-8231-42e5-b100-3619c96f8aa8 tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "5835c857-b74a-4a93-a6c5-55280540efa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:51:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:51:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:51:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:00 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:00 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:52:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:52:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.009s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:52:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:52:09 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.158958435058594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:52:09 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:52:10 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:52:10 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:52:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG nova.compute.manager [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing instance network info cache due to event network-changed-fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] Acquiring lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] Acquired lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG nova.network.neutron [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Refreshing network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:21 user nova-compute[75340]: INFO nova.compute.manager [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Terminating instance
Nov 30 09:52:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:21 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.network.neutron [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updated VIF entry in instance network info cache for port fa55fd8d-a269-4989-ad6f-bd8b5629b393. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.network.neutron [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [{"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2df5ad68-a96d-491c-bf9c-aee47e27734e req-eab2e828-60ea-45c2-b8bb-0005dc9d9afe service nova] Releasing lock "refresh_cache-8f535bfb-4ab4-4746-be3f-ff81f8c61d08" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:52:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Instance destroyed successfully.
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lazy-loading 'resources' on Instance uuid 8f535bfb-4ab4-4746-be3f-ff81f8c61d08 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1038879179',display_name='tempest-TestVolumeBootPattern-server-1038879179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1038879179',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwYRaiTKKy33O6/7PE+P7id7MSL98VTPb/Z0e6Em0Q1fqYN3mT/jxnJqhPyPLOZQwE1ohzCs8w8le2Vg8iGKv6Db6npka3BzB9p6h0pqNiSs9568xVSk5+fGumMOasQg==',key_name='tempest-TestVolumeBootPattern-1416609773',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:47:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44adf4b9fd2b47559a452ee5d13876e6',ramdisk_id='',reservation_id='r-wcbmgj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2091409042',owner_user_name='tempest-TestVolumeBootPattern-2091409042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:47:42Z,user_data=None,user_id='5e85e448fe394ce1a7775cde196d0fb2',uuid=8f535bfb-4ab4-4746-be3f-ff81f8c61d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converting VIF {"id": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "address": "fa:16:3e:4a:f8:ae", "network": {"id": "9b2871fa-6190-4b78-a308-8ac5ac2e1121", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1516586870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44adf4b9fd2b47559a452ee5d13876e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa55fd8d-a2", "ovs_interfaceid": "fa55fd8d-a269-4989-ad6f-bd8b5629b393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_vif [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa55fd8d-a2, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdd91cfc-90ae-49fc-b1fa-9a18f4d9c6c4) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:22 user nova-compute[75340]: INFO os_vif [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:ae,bridge_name='br-int',has_traffic_filtering=True,id=fa55fd8d-a269-4989-ad6f-bd8b5629b393,network=Network(9b2871fa-6190-4b78-a308-8ac5ac2e1121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa55fd8d-a2')
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJSgFlZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:52:22 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ea408-c2cb-412a-8c12-74be85618512]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:52:22 user nova-compute[75340]: No targets found.
Nov 30 09:52:22 user nova-compute[75340]: iSNS:
Nov 30 09:52:22 user nova-compute[75340]: No targets found.
Nov 30 09:52:22 user nova-compute[75340]: STATIC:
Nov 30 09:52:22 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63
Nov 30 09:52:22 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:52:22 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:52:22 user nova-compute[75340]: FIRMWARE:
Nov 30 09:52:22 user nova-compute[75340]: No targets found.
Nov 30 09:52:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:52:22 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:52:22 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61b6d73-c835-4c18-923c-dc15d0ef08f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d00bc8c-103a-4d93-96c7-5b36d03d0f4a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:52:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 (non-flash)
Nov 30 09:52:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5026cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e91ef-2b6c-4701-adcc-41b7e2896fdb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe32e85-0df5-44b6-80c1-0a1d7a5ab1b3]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a6eb58-3eed-441c-86f7-899aa029b302]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a476e-e84e-419b-aab9-0072d239460d]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3487235-197306f9b418b84a', '/dev/disk/by-id/scsi-23139373330366639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3487235') {{(pid=86898) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9b680-6229-49f1-9c3a-71addb066e1b]: (4, None) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d13e4f-4d4f-4967-ae3f-4387a4e8dc21]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb4f1c-57e6-4d99-b91c-5975c209de80]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260]
Nov 30 09:52:22 user nova-compute[75340]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63, portal: 172.16.0.220,3260] successful.
Nov 30 09:52:22 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ad606b-7ebf-4ce0-afa6-3e55248cfe63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d91b9-9c40-4782-ab67-a0aa73664f41]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] <== disconnect_volume: return (324ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:52:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:52:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Deleting instance files /opt/stack/data/nova/instances/8f535bfb-4ab4-4746-be3f-ff81f8c61d08_del
Nov 30 09:52:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Deletion of /opt/stack/data/nova/instances/8f535bfb-4ab4-4746-be3f-ff81f8c61d08_del complete
Nov 30 09:52:23 user nova-compute[75340]: INFO nova.compute.manager [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:52:23 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Took 0.46 seconds to deallocate network for instance.
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-unplugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] No waiting events found dispatching network-vif-unplugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-unplugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Acquiring lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] No waiting events found dispatching network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:52:23 user nova-compute[75340]: WARNING nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received unexpected event network-vif-plugged-fa55fd8d-a269-4989-ad6f-bd8b5629b393 for instance with vm_state active and task_state deleting.
Nov 30 09:52:23 user nova-compute[75340]: DEBUG nova.compute.manager [req-0a0fef87-a674-41fe-a28a-ce63dfdc52b6 req-ded9e39c-3b40-49d5-ad43-e3e95b2f712f service nova] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Received event network-vif-deleted-fa55fd8d-a269-4989-ad6f-bd8b5629b393 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:52:24 user nova-compute[75340]: INFO nova.compute.manager [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] [instance: 8f535bfb-4ab4-4746-be3f-ff81f8c61d08] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 09:52:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:52:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:52:24 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:52:24 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:52:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:24 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Deleted allocations for instance 8f535bfb-4ab4-4746-be3f-ff81f8c61d08
Nov 30 09:52:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ac58e2a0-86fb-4c86-b4e1-aa43bd45a01c tempest-TestVolumeBootPattern-2091409042 tempest-TestVolumeBootPattern-2091409042-project-member] Lock "8f535bfb-4ab4-4746-be3f-ff81f8c61d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:52:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:52:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:52:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:53:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:53:04 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:53:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:53:10 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:53:11 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:53:11 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9161MB free_disk=25.15808868408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:53:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:53:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:53:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:53:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:53:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:53:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:54:05 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:10 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:54:11 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:54:11 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.15628433227539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:54:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:54:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:54:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:56 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 09:54:56 user nova-compute[75340]: INFO nova.compute.claims [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Claim successful on node user
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 09:54:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.policy [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60b0c6efd51c473188cbff0111f3b3e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7aa86f987104c0ca22ed437b2069849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 09:54:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Creating image(s)
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "/opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "/opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "/opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.172s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.165s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk 1073741824" returned: 0 in 0.050s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Successfully created port: a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Cannot resize image /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Ensure instance console log exists: /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:54:58 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Successfully updated port: a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-changed-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.compute.manager [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Refreshing instance network info cache due to event network-changed-a7b945c4-748d-40cf-95cd-6509d97eb0d7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Instance network_info: |[{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Refreshing network info cache for port a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Start _get_guest_xml network_info=[{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 09:54:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:54:59 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-473298098',display_name='tempest-SnapshotDataIntegrityTests-server-473298098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-473298098',id=52,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWBYb0S1StFswgmN66RMSpKcQE/SWREbEER9NzuYUybBLHxzgXnWlF3akgIxvtp5PTdZ+ooaoanRKpY1dl9zVqJwliLjifveIL02+jDTWxePN7nLgSx1Esm0JjwiUjuKQ==',key_name='tempest-keypair-1271559605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7aa86f987104c0ca22ed437b2069849',ramdisk_id='',reservation_id='r-ocw1fl4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-12296208',owner_user_name='tempest-SnapshotDataIntegrityTests-12296208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b0c6efd51c473188cbff0111f3b3e5',uuid=3084a708-f8e4-4e88-a140-653a36ff3185,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converting VIF {"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'pci_devices' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] End _get_guest_xml xml=<domain type="kvm">
Nov 30 09:54:59 user nova-compute[75340]:   <uuid>3084a708-f8e4-4e88-a140-653a36ff3185</uuid>
Nov 30 09:54:59 user nova-compute[75340]:   <name>instance-00000034</name>
Nov 30 09:54:59 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 09:54:59 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 09:54:59 user nova-compute[75340]:   <metadata>
Nov 30 09:54:59 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 09:54:59 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-473298098</nova:name>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:creationTime>2023-11-30 09:54:59</nova:creationTime>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 09:54:59 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 09:54:59 user nova-compute[75340]:       </nova:flavor>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:owner>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:user uuid="60b0c6efd51c473188cbff0111f3b3e5">tempest-SnapshotDataIntegrityTests-12296208-project-member</nova:user>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:project uuid="b7aa86f987104c0ca22ed437b2069849">tempest-SnapshotDataIntegrityTests-12296208</nova:project>
Nov 30 09:54:59 user nova-compute[75340]:       </nova:owner>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 09:54:59 user nova-compute[75340]:       <nova:ports>
Nov 30 09:54:59 user nova-compute[75340]:         <nova:port uuid="a7b945c4-748d-40cf-95cd-6509d97eb0d7">
Nov 30 09:54:59 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 09:54:59 user nova-compute[75340]:         </nova:port>
Nov 30 09:54:59 user nova-compute[75340]:       </nova:ports>
Nov 30 09:54:59 user nova-compute[75340]:     </nova:instance>
Nov 30 09:54:59 user nova-compute[75340]:   </metadata>
Nov 30 09:54:59 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 09:54:59 user nova-compute[75340]:     <system>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="serial">3084a708-f8e4-4e88-a140-653a36ff3185</entry>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="uuid">3084a708-f8e4-4e88-a140-653a36ff3185</entry>
Nov 30 09:54:59 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 09:54:59 user nova-compute[75340]:     </system>
Nov 30 09:54:59 user nova-compute[75340]:   </sysinfo>
Nov 30 09:54:59 user nova-compute[75340]:   <os>
Nov 30 09:54:59 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 09:54:59 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 09:54:59 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 09:54:59 user nova-compute[75340]:   </os>
Nov 30 09:54:59 user nova-compute[75340]:   <features>
Nov 30 09:54:59 user nova-compute[75340]:     <acpi/>
Nov 30 09:54:59 user nova-compute[75340]:     <apic/>
Nov 30 09:54:59 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 09:54:59 user nova-compute[75340]:   </features>
Nov 30 09:54:59 user nova-compute[75340]:   <clock offset="utc">
Nov 30 09:54:59 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 09:54:59 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 09:54:59 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 09:54:59 user nova-compute[75340]:   </clock>
Nov 30 09:54:59 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 09:54:59 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 09:54:59 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 09:54:59 user nova-compute[75340]:   </cpu>
Nov 30 09:54:59 user nova-compute[75340]:   <devices>
Nov 30 09:54:59 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 09:54:59 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 09:54:59 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk"/>
Nov 30 09:54:59 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 09:54:59 user nova-compute[75340]:     </disk>
Nov 30 09:54:59 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 09:54:59 user nova-compute[75340]:       <mac address="fa:16:3e:02:2d:3c"/>
Nov 30 09:54:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:54:59 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 09:54:59 user nova-compute[75340]:       <target dev="tapa7b945c4-74"/>
Nov 30 09:54:59 user nova-compute[75340]:     </interface>
Nov 30 09:54:59 user nova-compute[75340]:     <serial type="pty">
Nov 30 09:54:59 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/console.log" append="off"/>
Nov 30 09:54:59 user nova-compute[75340]:     </serial>
Nov 30 09:54:59 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 09:54:59 user nova-compute[75340]:     <video>
Nov 30 09:54:59 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 09:54:59 user nova-compute[75340]:     </video>
Nov 30 09:54:59 user nova-compute[75340]:     <rng model="virtio">
Nov 30 09:54:59 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 09:54:59 user nova-compute[75340]:     </rng>
Nov 30 09:54:59 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 09:54:59 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 09:54:59 user nova-compute[75340]:       <stats period="10"/>
Nov 30 09:54:59 user nova-compute[75340]:     </memballoon>
Nov 30 09:54:59 user nova-compute[75340]:   </devices>
Nov 30 09:54:59 user nova-compute[75340]: </domain>
Nov 30 09:54:59 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-473298098',display_name='tempest-SnapshotDataIntegrityTests-server-473298098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-473298098',id=52,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWBYb0S1StFswgmN66RMSpKcQE/SWREbEER9NzuYUybBLHxzgXnWlF3akgIxvtp5PTdZ+ooaoanRKpY1dl9zVqJwliLjifveIL02+jDTWxePN7nLgSx1Esm0JjwiUjuKQ==',key_name='tempest-keypair-1271559605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7aa86f987104c0ca22ed437b2069849',ramdisk_id='',reservation_id='r-ocw1fl4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-12296208',owner_user_name='tempest-SnapshotDataIntegrityTests-12296208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T09:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b0c6efd51c473188cbff0111f3b3e5',uuid=3084a708-f8e4-4e88-a140-653a36ff3185,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converting VIF {"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG os_vif [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86a3f5fb-42b9-51b7-be44-dbecc04da9ed', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7b945c4-74, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7b945c4-74, col_values=(('qos', UUID('f0ec0fa9-6717-4675-b308-852322e8fb57')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7b945c4-74, col_values=(('external_ids', {'iface-id': 'a7b945c4-748d-40cf-95cd-6509d97eb0d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:2d:3c', 'vm-uuid': '3084a708-f8e4-4e88-a140-653a36ff3185'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: INFO os_vif [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74')
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No VIF found with MAC fa:16:3e:02:2d:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated VIF entry in instance network info cache for port a7b945c4-748d-40cf-95cd-6509d97eb0d7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG nova.network.neutron [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:54:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-95774d32-dcca-48f8-b7c5-9f8e5554ede4 req-b2e6634a-20e8-4205-9ea1-f9cc62cecbf9 service nova] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:55:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] No waiting events found dispatching network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:55:01 user nova-compute[75340]: WARNING nova.compute.manager [req-3221f4dd-0435-4d8c-b62b-8a7294c7283c req-9c0b1da8-fce8-4cae-a0b1-aa66ca37f7ba service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received unexpected event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 for instance with vm_state building and task_state spawning.
Nov 30 09:55:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 09:55:03 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Instance spawned successfully.
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] No waiting events found dispatching network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 09:55:03 user nova-compute[75340]: WARNING nova.compute.manager [req-5abb4de1-a10f-43db-85d2-6ef42778d18d req-006ba7c2-e063-486f-952e-d58a56e41c93 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received unexpected event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 for instance with vm_state building and task_state spawning.
Nov 30 09:55:03 user nova-compute[75340]: INFO nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 30 09:55:03 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 09:55:03 user nova-compute[75340]: INFO nova.compute.manager [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Took 6.35 seconds to build instance.
Nov 30 09:55:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4a29f79e-22ca-4528-a47d-8eec28bd25c0 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.437s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:55:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:04 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:04 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:55:07 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:55:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:55:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:55:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.15292739868164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:55:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:55:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:55:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 09:55:34 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 09:55:36 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:55:36 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 09:55:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:55:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:55:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:55:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:06 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:06 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:56:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:09 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:56:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:56:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:56:12 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=25.124561309814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:56:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:56:14 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:56:15 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:56:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:56:15 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:56:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:27 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-changed-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 09:56:47 user nova-compute[75340]: DEBUG nova.compute.manager [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Refreshing instance network info cache due to event network-changed-a7b945c4-748d-40cf-95cd-6509d97eb0d7. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 09:56:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:56:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:56:47 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Refreshing network info cache for port a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 09:56:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated VIF entry in instance network info cache for port a7b945c4-748d-40cf-95cd-6509d97eb0d7. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 09:56:48 user nova-compute[75340]: DEBUG nova.network.neutron [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:56:48 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-2ea64f0c-7c2a-4f5c-8161-fe1e810370de req-0e5e6964-9b44-4bb0-bf56-e97aa07d8169 service nova] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG nova.objects.instance [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:56:51 user nova-compute[75340]: INFO nova.compute.manager [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attaching volume 06319d7d-c32f-4410-bdd8-d669929d5821 to /dev/vdb
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c465ef9-19b9-44e3-baea-b8ac904e1248]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e835c92-4da7-4027-8848-9863038290f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c822e3-f72d-4e54-985a-a92ff1b538aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe2ceb-495e-465f-ae83-c3fc730244cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:56:51 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:56:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e058c-d721-4502-8a49-22470cd980ec]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG os_brick.utils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:56:51 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating existing volume attachment record: 307982a9-2efb-4ef0-aefb-68352187fcd9 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:56:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:56:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOzvBDIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:57:00 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:57:00 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:57:00 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000631c-2edf-4185-99b7-5dc1437452c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:57:00 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33e472-8b00-41c3-9311-2e56d7aac5c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821] added
Nov 30 09:57:00 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4da257-0e71-48bf-83b6-c81507ce7937]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc5b4a-d15b-4452-af2e-7eac9685bad4]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOzvBDIi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOzvBDIi" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2b4464-795a-4e7e-ab68-d7651ac4caf0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KOzvBDIi'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6351f-c68d-4e76-a2e9-9ee36b2f723e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f0c1d6-633c-4d5b-a428-453ebadc442d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:57:00 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:57:00 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:57:00 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:57:00 user nova-compute[75340]: 
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcd269f-873d-4a5e-998b-5fa7088c219d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260]
Nov 30 09:57:00 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260] successful.
Nov 30 09:57:00 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ca3e6-c516-46b7-a4a8-fa726e14ccbb]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[84066f8c-d382-4bd4-ba22-a07da06e38be]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)
Nov 30 09:57:00 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)
Nov 30 09:57:00 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f51a7f-6b7d-49c3-a912-00bc482e2216]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:00 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOzvBDIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26162646264353730', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162646264353730', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG nova.objects.instance [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:57:01 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:57:01 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:57:01 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:57:01 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:57:01 user nova-compute[75340]:   <serial>06319d7d-c32f-4410-bdd8-d669929d5821</serial>
Nov 30 09:57:01 user nova-compute[75340]: </disk>
Nov 30 09:57:01 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:57:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:57:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:57:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No VIF found with MAC fa:16:3e:02:2d:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:57:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-8ab78bfa-d213-485c-b1d2-11e1a3d8d98e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.784s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:57:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:57:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:57:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75340) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 09:57:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:57:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.123382568359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:57:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:57:16 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:57:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:57:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:57:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:57:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:57:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:57:19 user nova-compute[75340]: INFO nova.compute.manager [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Detaching volume 06319d7d-c32f-4410-bdd8-d669929d5821
Nov 30 09:57:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:19 user nova-compute[75340]: INFO nova.virt.block_device [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attempting to driver detach volume 06319d7d-c32f-4410-bdd8-d669929d5821 from mountpoint /dev/vdb
Nov 30 09:57:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Attempting to detach device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:57:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:57:19 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:57:19 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:57:19 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:57:19 user nova-compute[75340]:   <serial>06319d7d-c32f-4410-bdd8-d669929d5821</serial>
Nov 30 09:57:19 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:57:19 user nova-compute[75340]: </disk>
Nov 30 09:57:19 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:57:19 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config.
Nov 30 09:57:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:57:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:57:19 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:57:19 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:57:19 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:57:19 user nova-compute[75340]:   <serial>06319d7d-c32f-4410-bdd8-d669929d5821</serial>
Nov 30 09:57:19 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:57:19 user nova-compute[75340]: </disk>
Nov 30 09:57:19 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:57:20 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:57:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:57:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:57:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:57:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:57:40 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 is timed out.
Nov 30 09:57:40 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config.
Nov 30 09:57:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOzvBDIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:57:40 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e820b7-256e-4340-bb89-a050d3ae561d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:57:40 user nova-compute[75340]: No targets found.
Nov 30 09:57:40 user nova-compute[75340]: iSNS:
Nov 30 09:57:40 user nova-compute[75340]: No targets found.
Nov 30 09:57:40 user nova-compute[75340]: STATIC:
Nov 30 09:57:40 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821
Nov 30 09:57:40 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:57:40 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:57:40 user nova-compute[75340]: FIRMWARE:
Nov 30 09:57:40 user nova-compute[75340]: No targets found.
Nov 30 09:57:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:57:40 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:57:40 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa25a1-eb03-47b6-80dc-691c4418238f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e5c5ad-a65e-43ff-b04a-339ede458c22]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)
Nov 30 09:57:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 (non-flash)
Nov 30 09:57:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff4814c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73e53b-b554-4907-8484-927e6baf789a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3459b03-c138-4819-bcf0-0778443defef]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d23dc3-49b7-4a29-9dcf-7fdf5606ff68]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f62324-17ce-474c-9818-a290b4e55429]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda13fa4-8db8-4ba7-9668-2694bbc1a158]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b39767-a85e-4178-b2cc-e0f67e16aba6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260]
Nov 30 09:57:40 user nova-compute[75340]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821, portal: 172.16.0.220,3260] successful.
Nov 30 09:57:40 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06319d7d-c32f-4410-bdd8-d669929d5821 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541cd4b-fbfd-4a46-9bd1-d02c23d06a94]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== disconnect_volume: return (293ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:57:40 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:57:41 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:57:41 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4b82f569-eea9-4133-b522-bf6a7524db4a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:57:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:57:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:57:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:08 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:08 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:58:12 user nova-compute[75340]: INFO nova.compute.manager [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attaching volume d7f8a71d-b418-49d9-a704-c7d665951896 to /dev/vdb
Nov 30 09:58:12 user nova-compute[75340]: DEBUG os_brick.utils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef26025-b80c-4f06-8f05-8acfa37d48ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c7cd5-68ac-494c-b589-c8a0afb1b668]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:12 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ed949-545d-4388-9c9a-1abf8d734e84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93c81d-ca7e-4760-a43e-82b6e6c0f677]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:58:13 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[341708f1-085f-4498-8373-f4051c467755]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG os_brick.utils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating existing volume attachment record: 2bfac0ad-7eda-404f-aa64-bd5c3b61669c {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:58:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:58:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.1146240234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:58:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:58:17 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:58:18 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:58:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:58:18 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:58:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYnpNkwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:58:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:58:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:58:21 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8129c2db-2380-4ff7-a1be-5c87857ecf43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:58:21 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef0edd-fee5-466e-9d13-aa5b5c15e958]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896] added
Nov 30 09:58:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c4c98-c22f-45d7-8fa8-2f6363c09223]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05db904-feb6-4740-9c86-b2f1d9e3a225]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYnpNkwx {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYnpNkwx" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2554ff-8313-4c66-8be7-b614a2d82c20]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYnpNkwx'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b510f45-237c-442d-be4e-c43038a21922]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65eb572-d745-47b1-a136-82c82f2ecb90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:58:21 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:58:21 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:58:21 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:58:21 user nova-compute[75340]: 
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12724d-8e5f-4654-bc1a-9682a02de366]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260]
Nov 30 09:58:21 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260] successful.
Nov 30 09:58:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8296ef-8a47-4200-addc-fc0992b1ba7b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de2a92-fadc-45aa-8a03-635bdf94e658]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)
Nov 30 09:58:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)
Nov 30 09:58:21 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ba462-338c-41f9-8fe0-e0328d44890f]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:58:21 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYnpNkwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:58:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:58:22 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26434633232373238', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:58:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434633232373238', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:58:22 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:58:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:58:22 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:58:22 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:58:22 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:58:22 user nova-compute[75340]:   <serial>d7f8a71d-b418-49d9-a704-c7d665951896</serial>
Nov 30 09:58:22 user nova-compute[75340]: </disk>
Nov 30 09:58:22 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:58:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:58:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:58:23 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No VIF found with MAC fa:16:3e:02:2d:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:58:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4375d0d2-8253-44d3-a435-650dbe136e58 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.298s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:58:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:58:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:58:25 user nova-compute[75340]: INFO nova.compute.manager [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Detaching volume d7f8a71d-b418-49d9-a704-c7d665951896
Nov 30 09:58:25 user nova-compute[75340]: INFO nova.virt.block_device [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attempting to driver detach volume d7f8a71d-b418-49d9-a704-c7d665951896 from mountpoint /dev/vdb
Nov 30 09:58:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Attempting to detach device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:58:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:58:25 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:58:25 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:58:25 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:58:25 user nova-compute[75340]:   <serial>d7f8a71d-b418-49d9-a704-c7d665951896</serial>
Nov 30 09:58:25 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:58:25 user nova-compute[75340]: </disk>
Nov 30 09:58:25 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:58:25 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config.
Nov 30 09:58:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:58:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:58:25 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:58:25 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:58:25 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:58:25 user nova-compute[75340]:   <serial>d7f8a71d-b418-49d9-a704-c7d665951896</serial>
Nov 30 09:58:25 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:58:25 user nova-compute[75340]: </disk>
Nov 30 09:58:25 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:58:25 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:58:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:29 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:58:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:58:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 is timed out.
Nov 30 09:58:45 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config.
Nov 30 09:58:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYnpNkwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:58:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae0a06-c6ae-40e5-b549-97a10495e598]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:58:45 user nova-compute[75340]: No targets found.
Nov 30 09:58:45 user nova-compute[75340]: iSNS:
Nov 30 09:58:45 user nova-compute[75340]: No targets found.
Nov 30 09:58:45 user nova-compute[75340]: STATIC:
Nov 30 09:58:45 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896
Nov 30 09:58:45 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:58:45 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:58:45 user nova-compute[75340]: FIRMWARE:
Nov 30 09:58:45 user nova-compute[75340]: No targets found.
Nov 30 09:58:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:58:45 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:58:45 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d190e1b1-bc3c-4b7e-9496-f8e3a3bd6e1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d730cd0c-236a-4671-8ea9-add03ace9f7f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)
Nov 30 09:58:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 (non-flash)
Nov 30 09:58:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff54f31750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18de4ae-e17f-4e41-9a38-41840d035616]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ecf27a-9fdc-4a1f-938a-98f0e24659eb]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde133e9-6276-4f06-8b04-4020d1476c63]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf47bb1-91c1-46fe-8403-f07154a149f9]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86cc429-aa2c-4660-9750-cb0a4b5649d7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de6e7b-ab1f-4c07-b001-d8276c9b38f1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260]
Nov 30 09:58:46 user nova-compute[75340]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896, portal: 172.16.0.220,3260] successful.
Nov 30 09:58:46 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7f8a71d-b418-49d9-a704-c7d665951896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f9cd8-6007-4a11-9462-f444bf4292f0]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== disconnect_volume: return (320ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:58:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:58:47 user nova-compute[75340]: DEBUG nova.objects.instance [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:58:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-29836c24-fe47-4c71-b512-176df953456e tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.898s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:58:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:58:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:10 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 09:59:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 09:59:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:59:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.113773345947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 09:59:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:59:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:59:18 user nova-compute[75340]: INFO nova.compute.manager [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attaching volume 89b6d97e-6218-4b4d-8643-11eb1609f197 to /dev/vdb
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.utils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc333b-1c26-4587-9ef0-c735a0283a64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9e58e-90a1-4a34-9ed3-6b8340525be5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d66c9-2ae7-4772-b995-7391d7b10ea2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43da43c-9f85-4570-b997-e486c8a054a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 09:59:18 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 09:59:18 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f5ae81-d049-4adb-85d9-73b29c0cd06f]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG os_brick.utils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:59:18 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating existing volume attachment record: c39cd07f-960d-43da-8bb2-4f19014569aa {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 09:59:19 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:59:20 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 09:59:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 09:59:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 09:59:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfZPiBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:59:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:59:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:59:27 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130f3eb-3a87-4de3-a054-d524869b79e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 09:59:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e472a6a-7129-4a3a-abd5-a304be7fc22d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197] added
Nov 30 09:59:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a80b0-e3d4-4de9-93ea-2caf698f7ddc]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ade64d-50f0-4bfb-bc28-55276e62afc5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfZPiBqX {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfZPiBqX" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad3baa7-4c1b-4329-8e72-a68e155bf40c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfZPiBqX'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e3574-0d82-474c-b570-43e4d4ff2270]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa0d7f-6314-4fd3-b632-011fc5c1e49b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:59:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 09:59:27 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:59:27 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 09:59:27 user nova-compute[75340]: 
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d772750-602c-45b6-a715-deb15f9a9356]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260]
Nov 30 09:59:27 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260] successful.
Nov 30 09:59:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc605c2-c415-426f-82c4-3e37a03f5808]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5c8b15-bc46-4d50-a434-a1d098498d41]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)
Nov 30 09:59:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)
Nov 30 09:59:27 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c8e2f0-3860-4d72-b0bf-5ae8455ed488]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 09:59:27 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfZPiBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26133386337663562', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133386337663562', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.objects.instance [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 09:59:28 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:59:28 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:59:28 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:59:28 user nova-compute[75340]:   <serial>89b6d97e-6218-4b4d-8643-11eb1609f197</serial>
Nov 30 09:59:28 user nova-compute[75340]: </disk>
Nov 30 09:59:28 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 09:59:28 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No VIF found with MAC fa:16:3e:02:2d:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 09:59:29 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-1b97d7dc-707d-4bbf-bf90-1899bbfa756a tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.550s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:59:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 09:59:30 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 09:59:30 user nova-compute[75340]: INFO nova.compute.manager [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Detaching volume 89b6d97e-6218-4b4d-8643-11eb1609f197
Nov 30 09:59:30 user nova-compute[75340]: INFO nova.virt.block_device [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attempting to driver detach volume 89b6d97e-6218-4b4d-8643-11eb1609f197 from mountpoint /dev/vdb
Nov 30 09:59:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Attempting to detach device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 09:59:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:59:30 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:59:30 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:59:30 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:59:30 user nova-compute[75340]:   <serial>89b6d97e-6218-4b4d-8643-11eb1609f197</serial>
Nov 30 09:59:30 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:59:30 user nova-compute[75340]: </disk>
Nov 30 09:59:30 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:59:30 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config.
Nov 30 09:59:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 09:59:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 09:59:30 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 09:59:30 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 09:59:30 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 09:59:30 user nova-compute[75340]:   <serial>89b6d97e-6218-4b4d-8643-11eb1609f197</serial>
Nov 30 09:59:30 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 09:59:30 user nova-compute[75340]: </disk>
Nov 30 09:59:30 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 09:59:31 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 09:59:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:51 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 is timed out.
Nov 30 09:59:51 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config.
Nov 30 09:59:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfZPiBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 09:59:51 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56ac8cb-0ab9-4813-a372-54f0ebc1c134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 09:59:51 user nova-compute[75340]: No targets found.
Nov 30 09:59:51 user nova-compute[75340]: iSNS:
Nov 30 09:59:51 user nova-compute[75340]: No targets found.
Nov 30 09:59:51 user nova-compute[75340]: STATIC:
Nov 30 09:59:51 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197
Nov 30 09:59:51 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 09:59:51 user nova-compute[75340]:                 Iface Name: default
Nov 30 09:59:51 user nova-compute[75340]: FIRMWARE:
Nov 30 09:59:51 user nova-compute[75340]: No targets found.
Nov 30 09:59:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 09:59:51 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 09:59:51 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e088d3-d91e-4598-9a57-ca4aee24cdf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc9da9f-0467-40e7-9824-cc42b0a77129]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)
Nov 30 09:59:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 (non-flash)
Nov 30 09:59:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307b2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae1af6-6eb2-44c5-bc4e-5361b49147d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[83127eac-77df-49c3-a8b5-13a8521c4ef6]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c11bf-0bba-4e53-9e76-9ea94be5a848]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9c857-c2a8-4317-8c50-ecca3c6081e6]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e91ca6-2871-4ab8-81d2-73341f6f8762]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c509361-ca62-4883-bb5a-cd088e89f8da]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260]
Nov 30 09:59:51 user nova-compute[75340]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197, portal: 172.16.0.220,3260] successful.
Nov 30 09:59:51 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6d97e-6218-4b4d-8643-11eb1609f197 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e89a9-9d0a-4f5d-8e91-1df97c23bbaf]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== disconnect_volume: return (275ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 09:59:51 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 09:59:52 user nova-compute[75340]: DEBUG nova.objects.instance [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 09:59:52 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-44390a8a-5a3c-4141-bea6-9aa89d21cc38 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 09:59:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 09:59:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:12 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:00:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:00:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.112838745117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:00:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:00:15 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:00:15 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:00:15 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:00:15 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:00:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:00:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:00:19 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:00:20 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:00:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:00:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:00:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:00:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:00:23 user nova-compute[75340]: DEBUG nova.objects.instance [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:00:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:00:24 user nova-compute[75340]: INFO nova.compute.manager [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attaching volume 36c2e4bb-1841-4d3b-927d-04cc41052a49 to /dev/vdb
Nov 30 10:00:24 user nova-compute[75340]: DEBUG os_brick.utils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8b551-97e9-49c0-8105-0c550654e109]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[03901320-b03e-4514-a40b-02a2b4ebbb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8a150-1d09-44ba-8919-e4c8ad8757f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427a150-b046-4bd1-8ec8-a30afc5a4cf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:00:25 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:00:25 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4e541-5a3a-4be0-95e7-c80c6d544128]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG os_brick.utils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:00:25 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating existing volume attachment record: f873625b-f019-46c4-8273-bcc6451e1f06 {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:00:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LajZCecV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:00:33 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:00:33 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:00:33 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc0deba-3847-4c93-aad1-63b52fdd6593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:00:33 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[43606a51-b07f-45b6-aed7-28994e3495ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49] added
Nov 30 10:00:33 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27b5e3-ccab-403e-a085-490210a31796]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0896183-3e81-4ade-957a-9aba7ba9cc33]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LajZCecV {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LajZCecV" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efec0b-358b-4f98-a579-01d149ccf4b3]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LajZCecV'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5b13f-b6df-4dbf-bf56-c0e5ddb2b31e]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a8f6b-f7cf-4950-b5bf-5f1b3e4cbb12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:00:33 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:00:33 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:00:33 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:00:33 user nova-compute[75340]: 
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[230144ee-02f2-40ae-8118-77bd7b7ec0a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260]
Nov 30 10:00:33 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260] successful.
Nov 30 10:00:33 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad464183-7a1d-4c8a-8c8b-c1fb7680b3f2]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f0d717-da1e-4984-8977-81231fc54ff1]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)
Nov 30 10:00:33 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)
Nov 30 10:00:33 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[06021e7c-4c3d-4e85-bc99-00a990f860ce]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:33 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LajZCecV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23439373739343164', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439373739343164', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:00:34 user nova-compute[75340]: DEBUG nova.objects.instance [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:00:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:00:35 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:00:35 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:00:35 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:00:35 user nova-compute[75340]:   <serial>36c2e4bb-1841-4d3b-927d-04cc41052a49</serial>
Nov 30 10:00:35 user nova-compute[75340]: </disk>
Nov 30 10:00:35 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:00:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:00:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:00:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] No VIF found with MAC fa:16:3e:02:2d:3c, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:00:35 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-86fb9f90-5f76-4389-bd75-f75f32000ec1 tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.632s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:00:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:00:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:00:37 user nova-compute[75340]: INFO nova.compute.manager [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Detaching volume 36c2e4bb-1841-4d3b-927d-04cc41052a49
Nov 30 10:00:37 user nova-compute[75340]: INFO nova.virt.block_device [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Attempting to driver detach volume 36c2e4bb-1841-4d3b-927d-04cc41052a49 from mountpoint /dev/vdb
Nov 30 10:00:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Attempting to detach device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:00:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:00:37 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:00:37 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:00:37 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:00:37 user nova-compute[75340]:   <serial>36c2e4bb-1841-4d3b-927d-04cc41052a49</serial>
Nov 30 10:00:37 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:00:37 user nova-compute[75340]: </disk>
Nov 30 10:00:37 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:00:37 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the persistent domain config.
Nov 30 10:00:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:00:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:00:37 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:00:37 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:00:37 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:00:37 user nova-compute[75340]:   <serial>36c2e4bb-1841-4d3b-927d-04cc41052a49</serial>
Nov 30 10:00:37 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:00:37 user nova-compute[75340]: </disk>
Nov 30 10:00:37 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:00:37 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:00:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:39 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:41 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:00:41 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:00:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:00:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:57 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3084a708-f8e4-4e88-a140-653a36ff3185 is timed out.
Nov 30 10:00:57 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully detached device vdb from instance 3084a708-f8e4-4e88-a140-653a36ff3185 from the live domain config.
Nov 30 10:00:57 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LajZCecV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:00:57 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[69284e82-efc8-4790-a066-c04ed0db2175]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:00:57 user nova-compute[75340]: No targets found.
Nov 30 10:00:57 user nova-compute[75340]: iSNS:
Nov 30 10:00:57 user nova-compute[75340]: No targets found.
Nov 30 10:00:57 user nova-compute[75340]: STATIC:
Nov 30 10:00:57 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49
Nov 30 10:00:57 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:00:57 user nova-compute[75340]:                 Iface Name: default
Nov 30 10:00:57 user nova-compute[75340]: FIRMWARE:
Nov 30 10:00:57 user nova-compute[75340]: No targets found.
Nov 30 10:00:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:00:57 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:00:57 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c758f-81a5-45e8-974b-bf1d46be766b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60cd7f-d05c-410a-9173-068a79d8823b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)
Nov 30 10:00:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 (non-flash)
Nov 30 10:00:57 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff307b29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:00:57 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[53df1124-6ff3-45ce-b5d0-adedd35c60ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aff0a4-cf6b-4ecf-a9e6-6027c97592ef]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9dd869-6afc-4b23-80b1-d0a6cd0ebf8a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0213988-1ba2-46f4-9ee1-7e7e942c30fa]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb29802-1f61-4f7b-8f7e-fc760385166c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1d25d-51ce-421a-82be-35cdf9e58ed6]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260]
Nov 30 10:00:58 user nova-compute[75340]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49, portal: 172.16.0.220,3260] successful.
Nov 30 10:00:58 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c2e4bb-1841-4d3b-927d-04cc41052a49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3f035-361d-4c6f-a9e3-28eb73254f0c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] <== disconnect_volume: return (311ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:00:58 user nova-compute[75340]: DEBUG nova.objects.instance [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'flavor' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-df3f5fab-38cb-4a1b-9e62-949d74c1ac1f tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:00:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:10 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:12 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:12 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:01:13 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:01:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:01:14 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.111812591552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance 3084a708-f8e4-4e88-a140-653a36ff3185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:01:14 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:01:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:01:21 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:01:22 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [{"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:01:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-3084a708-f8e4-4e88-a140-653a36ff3185" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:01:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:01:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Triggering sync for uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:01:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:01:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:01:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:01:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:01:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:01:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:01:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:01 user nova-compute[75340]: INFO nova.compute.manager [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Terminating instance
Nov 30 10:02:01 user nova-compute[75340]: DEBUG nova.compute.manager [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-unplugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] No waiting events found dispatching network-vif-unplugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:02:01 user nova-compute[75340]: DEBUG nova.compute.manager [req-c33952b9-fa09-4bdb-b3a3-ef6eeee2596c req-3b401e20-7d67-460a-9468-c6c82fc7dea1 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-unplugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Instance destroyed successfully.
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.objects.instance [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lazy-loading 'resources' on Instance uuid 3084a708-f8e4-4e88-a140-653a36ff3185 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T09:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-473298098',display_name='tempest-SnapshotDataIntegrityTests-server-473298098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-473298098',id=52,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWBYb0S1StFswgmN66RMSpKcQE/SWREbEER9NzuYUybBLHxzgXnWlF3akgIxvtp5PTdZ+ooaoanRKpY1dl9zVqJwliLjifveIL02+jDTWxePN7nLgSx1Esm0JjwiUjuKQ==',key_name='tempest-keypair-1271559605',keypairs=<?>,launch_index=0,launched_at=2023-11-30T09:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7aa86f987104c0ca22ed437b2069849',ramdisk_id='',reservation_id='r-ocw1fl4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-12296208',owner_user_name='tempest-SnapshotDataIntegrityTests-12296208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T09:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b0c6efd51c473188cbff0111f3b3e5',uuid=3084a708-f8e4-4e88-a140-653a36ff3185,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converting VIF {"id": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "address": "fa:16:3e:02:2d:3c", "network": {"id": "f68cfe4c-6d4e-4287-9915-5df9ba66666a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1133350572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7aa86f987104c0ca22ed437b2069849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7b945c4-74", "ovs_interfaceid": "a7b945c4-748d-40cf-95cd-6509d97eb0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG os_vif [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7b945c4-74, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0ec0fa9-6717-4675-b308-852322e8fb57) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:02 user nova-compute[75340]: INFO os_vif [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:2d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7b945c4-748d-40cf-95cd-6509d97eb0d7,network=Network(f68cfe4c-6d4e-4287-9915-5df9ba66666a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7b945c4-74')
Nov 30 10:02:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Deleting instance files /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185_del
Nov 30 10:02:02 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Deletion of /opt/stack/data/nova/instances/3084a708-f8e4-4e88-a140-653a36ff3185_del complete
Nov 30 10:02:02 user nova-compute[75340]: INFO nova.compute.manager [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 10:02:02 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:02:02 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:02:03 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Took 0.93 seconds to deallocate network for instance.
Nov 30 10:02:03 user nova-compute[75340]: DEBUG nova.compute.manager [req-8a1aa2cc-361d-481a-ad6c-0d16566b33f7 req-7b95e231-47ad-4b52-8966-5957521a3691 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-deleted-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:02:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:03 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Deleted allocations for instance 3084a708-f8e4-4e88-a140-653a36ff3185
Nov 30 10:02:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-cd9222cc-62b9-40da-8be2-ad43c438e4ae tempest-SnapshotDataIntegrityTests-12296208 tempest-SnapshotDataIntegrityTests-12296208-project-member] Lock "3084a708-f8e4-4e88-a140-653a36ff3185" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:02:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] Acquiring lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:04 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] Lock "3084a708-f8e4-4e88-a140-653a36ff3185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:04 user nova-compute[75340]: DEBUG nova.compute.manager [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] No waiting events found dispatching network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:02:04 user nova-compute[75340]: WARNING nova.compute.manager [req-a6789afc-8e71-4417-87f8-5345200b9475 req-f4f77207-5813-4fe2-918b-6a6321d95070 service nova] [instance: 3084a708-f8e4-4e88-a140-653a36ff3185] Received unexpected event network-vif-plugged-a7b945c4-748d-40cf-95cd-6509d97eb0d7 for instance with vm_state deleted and task_state None.
Nov 30 10:02:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:02:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:02:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:15 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:02:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:02:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.138900756835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:02:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:02:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:18 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:02:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:02:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:02:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:27 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:34 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:02:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:02:52 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:57 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:02:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:02 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:07 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:11 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:12 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:03:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:03:15 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:15 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:03:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:03:16 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9208MB free_disk=25.141239166259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:03:16 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:17 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:03:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:22 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:03:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:03:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:03:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:27 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:03:29 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:32 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:37 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Starting instance... {{(pid=75340) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75340) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:03:42 user nova-compute[75340]: INFO nova.compute.claims [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Claim successful on node user
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Start building networks asynchronously for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Allocating IP information in the background. {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] allocate_for_instance() {{(pid=75340) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:03:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Start building block device mappings for instance. {{(pid=75340) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.policy [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9304bd90ce6c4d8a90f07eda21e3565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c59630e585433d8e7c92c7da4ed03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75340) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Start spawning the instance on the hypervisor. {{(pid=75340) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Creating instance directory {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:03:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Creating image(s)
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "/opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "/opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.213s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.234s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk 1073741824 {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb,backing_fmt=raw /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk 1073741824" returned: 0 in 0.063s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "bbab4c7dcc70b388388869f4ce7618041180b9cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbab4c7dcc70b388388869f4ce7618041180b9cb --force-share --output=json" returned: 0 in 0.202s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk. size=1073741824 {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Successfully created port: db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG nova.virt.disk.api [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Cannot resize image /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk to a smaller size. {{(pid=75340) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Created local disks {{(pid=75340) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Ensure instance console log exists: /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/console.log {{(pid=75340) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Successfully updated port: db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Building network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-changed-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Refreshing instance network info cache due to event network-changed-db0a7ef0-f252-4b32-b942-f46ab0df2c3d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Instance cache missing network info. {{(pid=75340) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:44 user nova-compute[75340]: DEBUG nova.network.neutron [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Instance network_info: |[{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75340) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Refreshing network info cache for port db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Start _get_guest_xml network_info=[{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'a858ddd5-7e49-4452-af44-f170b5cc722b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:03:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:03:45 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CPU controller missing on host. {{(pid=75340) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.host [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CPU controller found on host. {{(pid=75340) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75340) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T09:09:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T09:09:58Z,direct_url=<?>,disk_format='qcow2',id=a858ddd5-7e49-4452-af44-f170b5cc722b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cc8213d4ad7945f4a5f1789dd0bbb526',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T09:09:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flavor limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Image limits 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flavor pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Image pref 0:0:0 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Got 1 possible topologies {{(pid=75340) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.hardware [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75340) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081540024',display_name='tempest-SnapshotDataIntegrityTests-server-1081540024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081540024',id=53,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETA0uRT0Xd/2oD614ldfOsTTnpKiVp9+nmsviyso9Xqn1WeBTOH8vMaxtUQGLmXHx0KKTQE3OI/kMLiHlP1CS/eTGbEb9wDnV/yYGR4uLhe9jmPZ8yUSLT8LqSkI8AKVw==',key_name='tempest-keypair-166272535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c59630e585433d8e7c92c7da4ed03d',ramdisk_id='',reservation_id='r-vpt59h9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-770682453',owner_user_name='tempest-SnapshotDataIntegrityTests-770682453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9304bd90ce6c4d8a90f07eda21e3565a',uuid=f5ca1485-9214-46ee-b776-f1fee2b728f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75340) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converting VIF {"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.objects.instance [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'pci_devices' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:03:45 user nova-compute[75340]:   <uuid>f5ca1485-9214-46ee-b776-f1fee2b728f6</uuid>
Nov 30 10:03:45 user nova-compute[75340]:   <name>instance-00000035</name>
Nov 30 10:03:45 user nova-compute[75340]:   <memory>524288</memory>
Nov 30 10:03:45 user nova-compute[75340]:   <vcpu>1</vcpu>
Nov 30 10:03:45 user nova-compute[75340]:   <metadata>
Nov 30 10:03:45 user nova-compute[75340]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:03:45 user nova-compute[75340]:       <nova:package version="0.0.0"/>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1081540024</nova:name>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:creationTime>2023-11-30 10:03:45</nova:creationTime>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:flavor name="m1.tiny">
Nov 30 10:03:45 user nova-compute[75340]:         <nova:memory>512</nova:memory>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:disk>1</nova:disk>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:swap>0</nova:swap>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:03:45 user nova-compute[75340]:       </nova:flavor>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:owner>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:user uuid="9304bd90ce6c4d8a90f07eda21e3565a">tempest-SnapshotDataIntegrityTests-770682453-project-member</nova:user>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:project uuid="85c59630e585433d8e7c92c7da4ed03d">tempest-SnapshotDataIntegrityTests-770682453</nova:project>
Nov 30 10:03:45 user nova-compute[75340]:       </nova:owner>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:root type="image" uuid="a858ddd5-7e49-4452-af44-f170b5cc722b"/>
Nov 30 10:03:45 user nova-compute[75340]:       <nova:ports>
Nov 30 10:03:45 user nova-compute[75340]:         <nova:port uuid="db0a7ef0-f252-4b32-b942-f46ab0df2c3d">
Nov 30 10:03:45 user nova-compute[75340]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 10:03:45 user nova-compute[75340]:         </nova:port>
Nov 30 10:03:45 user nova-compute[75340]:       </nova:ports>
Nov 30 10:03:45 user nova-compute[75340]:     </nova:instance>
Nov 30 10:03:45 user nova-compute[75340]:   </metadata>
Nov 30 10:03:45 user nova-compute[75340]:   <sysinfo type="smbios">
Nov 30 10:03:45 user nova-compute[75340]:     <system>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="version">0.0.0</entry>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="serial">f5ca1485-9214-46ee-b776-f1fee2b728f6</entry>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="uuid">f5ca1485-9214-46ee-b776-f1fee2b728f6</entry>
Nov 30 10:03:45 user nova-compute[75340]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:03:45 user nova-compute[75340]:     </system>
Nov 30 10:03:45 user nova-compute[75340]:   </sysinfo>
Nov 30 10:03:45 user nova-compute[75340]:   <os>
Nov 30 10:03:45 user nova-compute[75340]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:03:45 user nova-compute[75340]:     <boot dev="hd"/>
Nov 30 10:03:45 user nova-compute[75340]:     <smbios mode="sysinfo"/>
Nov 30 10:03:45 user nova-compute[75340]:   </os>
Nov 30 10:03:45 user nova-compute[75340]:   <features>
Nov 30 10:03:45 user nova-compute[75340]:     <acpi/>
Nov 30 10:03:45 user nova-compute[75340]:     <apic/>
Nov 30 10:03:45 user nova-compute[75340]:     <vmcoreinfo/>
Nov 30 10:03:45 user nova-compute[75340]:   </features>
Nov 30 10:03:45 user nova-compute[75340]:   <clock offset="utc">
Nov 30 10:03:45 user nova-compute[75340]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:03:45 user nova-compute[75340]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:03:45 user nova-compute[75340]:     <timer name="hpet" present="no"/>
Nov 30 10:03:45 user nova-compute[75340]:   </clock>
Nov 30 10:03:45 user nova-compute[75340]:   <cpu mode="custom" match="exact">
Nov 30 10:03:45 user nova-compute[75340]:     <model>Nehalem</model>
Nov 30 10:03:45 user nova-compute[75340]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:03:45 user nova-compute[75340]:   </cpu>
Nov 30 10:03:45 user nova-compute[75340]:   <devices>
Nov 30 10:03:45 user nova-compute[75340]:     <disk type="file" device="disk">
Nov 30 10:03:45 user nova-compute[75340]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:03:45 user nova-compute[75340]:       <source file="/opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk"/>
Nov 30 10:03:45 user nova-compute[75340]:       <target dev="vda" bus="virtio"/>
Nov 30 10:03:45 user nova-compute[75340]:     </disk>
Nov 30 10:03:45 user nova-compute[75340]:     <interface type="ethernet">
Nov 30 10:03:45 user nova-compute[75340]:       <mac address="fa:16:3e:41:51:05"/>
Nov 30 10:03:45 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 10:03:45 user nova-compute[75340]:       <mtu size="1442"/>
Nov 30 10:03:45 user nova-compute[75340]:       <target dev="tapdb0a7ef0-f2"/>
Nov 30 10:03:45 user nova-compute[75340]:     </interface>
Nov 30 10:03:45 user nova-compute[75340]:     <serial type="pty">
Nov 30 10:03:45 user nova-compute[75340]:       <log file="/opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/console.log" append="off"/>
Nov 30 10:03:45 user nova-compute[75340]:     </serial>
Nov 30 10:03:45 user nova-compute[75340]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:03:45 user nova-compute[75340]:     <video>
Nov 30 10:03:45 user nova-compute[75340]:       <model type="virtio"/>
Nov 30 10:03:45 user nova-compute[75340]:     </video>
Nov 30 10:03:45 user nova-compute[75340]:     <rng model="virtio">
Nov 30 10:03:45 user nova-compute[75340]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:03:45 user nova-compute[75340]:     </rng>
Nov 30 10:03:45 user nova-compute[75340]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:03:45 user nova-compute[75340]:     <memballoon model="virtio">
Nov 30 10:03:45 user nova-compute[75340]:       <stats period="10"/>
Nov 30 10:03:45 user nova-compute[75340]:     </memballoon>
Nov 30 10:03:45 user nova-compute[75340]:   </devices>
Nov 30 10:03:45 user nova-compute[75340]: </domain>
Nov 30 10:03:45 user nova-compute[75340]:  {{(pid=75340) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081540024',display_name='tempest-SnapshotDataIntegrityTests-server-1081540024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081540024',id=53,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETA0uRT0Xd/2oD614ldfOsTTnpKiVp9+nmsviyso9Xqn1WeBTOH8vMaxtUQGLmXHx0KKTQE3OI/kMLiHlP1CS/eTGbEb9wDnV/yYGR4uLhe9jmPZ8yUSLT8LqSkI8AKVw==',key_name='tempest-keypair-166272535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c59630e585433d8e7c92c7da4ed03d',ramdisk_id='',reservation_id='r-vpt59h9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-770682453',owner_user_name='tempest-SnapshotDataIntegrityTests-770682453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9304bd90ce6c4d8a90f07eda21e3565a',uuid=f5ca1485-9214-46ee-b776-f1fee2b728f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converting VIF {"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG os_vif [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2') {{(pid=75340) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd37c0429-92a1-572a-93de-64735e1b6935', '_type': 'linux-noop'}}, row=False) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb0a7ef0-f2, may_exist=True, interface_attrs={}) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb0a7ef0-f2, col_values=(('qos', UUID('c703414a-14db-4e83-9883-f0dc9e881bca')),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb0a7ef0-f2, col_values=(('external_ids', {'iface-id': 'db0a7ef0-f252-4b32-b942-f46ab0df2c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:51:05', 'vm-uuid': 'f5ca1485-9214-46ee-b776-f1fee2b728f6'}),), if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:45 user nova-compute[75340]: INFO os_vif [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2')
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No VIF found with MAC fa:16:3e:41:51:05, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated VIF entry in instance network info cache for port db0a7ef0-f252-4b32-b942-f46ab0df2c3d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG nova.network.neutron [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:03:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-86520de3-2524-4dbe-ba3b-f2ca6897f3a6 req-e830232b-2977-4b0e-b8f1-3a97a423b899 service nova] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:46 user nova-compute[75340]: DEBUG nova.compute.manager [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] No waiting events found dispatching network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:03:46 user nova-compute[75340]: WARNING nova.compute.manager [req-9b448398-ef8c-42ba-856f-642b21d44ea6 req-1c4c5294-d9c0-4a65-ae25-2baf338c38d1 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received unexpected event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d for instance with vm_state building and task_state spawning.
Nov 30 10:03:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:47 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.compute.manager [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] No waiting events found dispatching network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:03:49 user nova-compute[75340]: WARNING nova.compute.manager [req-0bfbef99-7fa0-4d54-bb8c-c37015000190 req-8e3b587b-90fa-4447-9cee-e688cf920c24 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received unexpected event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d for instance with vm_state building and task_state spawning.
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Instance event wait completed in 0 seconds for  {{(pid=75340) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Guest created on hypervisor {{(pid=75340) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:03:49 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Instance spawned successfully.
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_cdrom_bus of ide {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_disk_bus of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_input_bus of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_pointer_model of None {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_video_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Found default for hw_vif_model of virtio {{(pid=75340) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:03:49 user nova-compute[75340]: INFO nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 30 10:03:49 user nova-compute[75340]: DEBUG nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Checking state {{(pid=75340) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:03:49 user nova-compute[75340]: INFO nova.compute.manager [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Took 7.16 seconds to build instance.
Nov 30 10:03:49 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-24c73b26-6019-419c-bcfb-488766bcfc86 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.282s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:03:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:03:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:03:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:13 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:14 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:04:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:04:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:04:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:04:18 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.0936279296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:04:18 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:04:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:04:24 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:04:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:04:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:37 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:04:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:04:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:04:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:04:56 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:14 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:16 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:05:19 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:20 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:05:20 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:05:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.09183120727539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:05:20 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:05:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:05:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:05:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:05:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-changed-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:05:32 user nova-compute[75340]: DEBUG nova.compute.manager [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Refreshing instance network info cache due to event network-changed-db0a7ef0-f252-4b32-b942-f46ab0df2c3d. {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:05:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:05:32 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:05:32 user nova-compute[75340]: DEBUG nova.network.neutron [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Refreshing network info cache for port db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:05:33 user nova-compute[75340]: DEBUG nova.network.neutron [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated VIF entry in instance network info cache for port db0a7ef0-f252-4b32-b942-f46ab0df2c3d. {{(pid=75340) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:05:33 user nova-compute[75340]: DEBUG nova.network.neutron [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:05:33 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-518af2d1-f09e-47c2-b71a-6a15d1140134 req-5e4fc738-758c-406a-b9c8-e642ad10ccb2 service nova] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:05:34 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:05:36 user nova-compute[75340]: INFO nova.compute.manager [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attaching volume f30351f7-60e0-4b4f-9323-e9194a38632f to /dev/vdb
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.utils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa488d-1ed5-4e8c-a568-d05d1d43464a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4506c90-835b-4df9-8eaf-e37cce7ff073]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e717f0-ba28-4447-9b5f-c6d172478b35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c7936-d5ab-4cb1-adca-c9d37e1a7d58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:05:36 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:05:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fecb00-a76a-44d7-87db-1f8606308b3b]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG os_brick.utils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:05:36 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating existing volume attachment record: a0e959e3-b496-41e2-a7cc-0d613e04e58c {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:05:39 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kudzXLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:05:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:05:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:05:45 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b5a7e3-806d-495e-ae9f-782035175b21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:05:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda58566-d78f-4b4e-b680-43e2f0bf631e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f] added
Nov 30 10:05:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366a891-49f5-434f-b4f7-5df7aa2b48e6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7faa3f-c35e-4d12-8e97-e19d352adaa5]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kudzXLOi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kudzXLOi" returned: 0 in 0.030s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ac84df-194c-44dd-b015-b8bec3c34835]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kudzXLOi'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f451ba8-5047-4be4-b535-e393ec3115c7]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae68bcd-c31c-49e9-92d3-464e8d60d709]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:05:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:05:45 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:05:45 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:05:45 user nova-compute[75340]: 
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d39682-ddb8-4ec3-94ab-b7daef9d1be4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260]
Nov 30 10:05:45 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260] successful.
Nov 30 10:05:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[86255496-6a06-4c4c-a9cb-387fc220ef0a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5f8aa-86c6-49be-84c4-782954b51f6c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)
Nov 30 10:05:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)
Nov 30 10:05:45 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e489f2bc-4d33-442a-92a3-ae9463ee24f9]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:05:45 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kudzXLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26266656665393363', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266656665393363', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG nova.objects.instance [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:05:46 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:05:46 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:05:46 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:05:46 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:05:46 user nova-compute[75340]:   <serial>f30351f7-60e0-4b4f-9323-e9194a38632f</serial>
Nov 30 10:05:46 user nova-compute[75340]: </disk>
Nov 30 10:05:46 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No VIF found with MAC fa:16:3e:41:51:05, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-ef72423c-85d3-4c3a-b47d-8b02df28286d tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.463s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:05:47 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:05:49 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:50 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:05:50 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:05:54 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:05:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:06:03 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:06:03 user nova-compute[75340]: INFO nova.compute.manager [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Detaching volume f30351f7-60e0-4b4f-9323-e9194a38632f
Nov 30 10:06:04 user nova-compute[75340]: INFO nova.virt.block_device [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attempting to driver detach volume f30351f7-60e0-4b4f-9323-e9194a38632f from mountpoint /dev/vdb
Nov 30 10:06:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Attempting to detach device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:06:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:06:04 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:06:04 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:06:04 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:06:04 user nova-compute[75340]:   <serial>f30351f7-60e0-4b4f-9323-e9194a38632f</serial>
Nov 30 10:06:04 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:06:04 user nova-compute[75340]: </disk>
Nov 30 10:06:04 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:06:04 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config.
Nov 30 10:06:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:06:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:06:04 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:06:04 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:06:04 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:06:04 user nova-compute[75340]:   <serial>f30351f7-60e0-4b4f-9323-e9194a38632f</serial>
Nov 30 10:06:04 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:06:04 user nova-compute[75340]: </disk>
Nov 30 10:06:04 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:06:04 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:06:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:17 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:06:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:06:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.090476989746094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:06:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:06:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:24 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 is timed out.
Nov 30 10:06:24 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config.
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kudzXLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:06:24 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6bb19-9b5d-4643-93db-3df6fd37ed24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:06:24 user nova-compute[75340]: No targets found.
Nov 30 10:06:24 user nova-compute[75340]: iSNS:
Nov 30 10:06:24 user nova-compute[75340]: No targets found.
Nov 30 10:06:24 user nova-compute[75340]: STATIC:
Nov 30 10:06:24 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f
Nov 30 10:06:24 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:06:24 user nova-compute[75340]:                 Iface Name: default
Nov 30 10:06:24 user nova-compute[75340]: FIRMWARE:
Nov 30 10:06:24 user nova-compute[75340]: No targets found.
Nov 30 10:06:24 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:06:24 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:06:24 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ae7dc-7384-4dd5-97ad-1a85f513c9bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f8231-5be0-41e7-b966-8a6fadaaba4e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)
Nov 30 10:06:24 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f (non-flash)
Nov 30 10:06:24 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff305a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2dd3be-a49f-49d6-9d75-4abc631b5514]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff43ce1-1777-4dee-b096-4803f3701766]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b73d4b1-57d3-4287-b5e2-007d6bf5572a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9e92c8-96e5-40dd-a7ed-f946b6d9ee1f]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[539fe61b-95d9-473f-a878-fd8fa0ad58be]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac83bad-19b3-4db7-8439-e22151668382]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260]
Nov 30 10:06:24 user nova-compute[75340]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f, portal: 172.16.0.220,3260] successful.
Nov 30 10:06:24 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30351f7-60e0-4b4f-9323-e9194a38632f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18da6f5-9944-491b-a037-e5b72b59ae84]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== disconnect_volume: return (275ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:06:24 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:06:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-2a786fdd-1212-44ca-94a7-a704f6f33056 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.799s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:06:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:30 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:38 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:06:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:06:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:06:57 user nova-compute[75340]: INFO nova.compute.manager [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attaching volume 6f85bccb-dca7-4ad9-8c9d-d4671a05913b to /dev/vdb
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b428e7-379b-4fbb-8858-64f553ae25cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40dcea1-f90f-47b6-9a80-b5b46ae30757]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b41772-13cb-4102-befd-e87ff9d74b2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f84eaf-9188-4146-b5f2-7e06008dd007]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:06:57 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:06:57 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[304979a7-6c53-4e04-baa2-289b5fc5d195]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG os_brick.utils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:06:57 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating existing volume attachment record: 62e0a9b9-f3b8-4c66-a6cc-784cc0d098da {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:06:59 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoAETmWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:07:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:07:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:07:05 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138bbf7-8499-40ed-97b0-d2d32dcf11d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:07:05 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[67440d6b-2d09-47fa-85cd-40b5d612a0b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b] added
Nov 30 10:07:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[48309e0b-6726-4fa6-a1ad-815a326a3cd8]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f445928-c259-4e3d-82d2-ac0df613f287]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoAETmWJ {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoAETmWJ" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bcb8ff-ac24-4a33-b3fd-274ddb370f2a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GoAETmWJ'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdea809d-2302-4963-b954-8758807194ff]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d43512-2804-4775-baa3-5c2deb3aba93]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:07:05 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:07:05 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:07:05 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:07:05 user nova-compute[75340]: 
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a361430-530d-4f05-aa76-7c5fd207a49f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260]
Nov 30 10:07:05 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260] successful.
Nov 30 10:07:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759ebf5-17dd-4ce5-b5d9-5d23453944b1]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd293a2c-5cad-45c0-b3a8-e27d317e3f0f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)
Nov 30 10:07:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)
Nov 30 10:07:05 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fadcc-e01b-49b8-a6e0-7fb9a926d55b]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:07:05 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoAETmWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:07:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:07:06 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26164323533613039', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:07:06 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164323533613039', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:07:06 user nova-compute[75340]: DEBUG nova.objects.instance [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:07:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:07:07 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:07:07 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:07:07 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:07:07 user nova-compute[75340]:   <serial>6f85bccb-dca7-4ad9-8c9d-d4671a05913b</serial>
Nov 30 10:07:07 user nova-compute[75340]: </disk>
Nov 30 10:07:07 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:07:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:07:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:07:07 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No VIF found with MAC fa:16:3e:41:51:05, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:07:07 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-d30b156f-ad85-414c-a8a3-a6bc270328ef tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.325s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:07:09 user nova-compute[75340]: INFO nova.compute.manager [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Detaching volume 6f85bccb-dca7-4ad9-8c9d-d4671a05913b
Nov 30 10:07:09 user nova-compute[75340]: INFO nova.virt.block_device [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attempting to driver detach volume 6f85bccb-dca7-4ad9-8c9d-d4671a05913b from mountpoint /dev/vdb
Nov 30 10:07:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Attempting to detach device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:07:09 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:07:09 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:07:09 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:07:09 user nova-compute[75340]:   <serial>6f85bccb-dca7-4ad9-8c9d-d4671a05913b</serial>
Nov 30 10:07:09 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:07:09 user nova-compute[75340]: </disk>
Nov 30 10:07:09 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:07:09 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config.
Nov 30 10:07:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:07:09 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:07:09 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:07:09 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:07:09 user nova-compute[75340]:   <serial>6f85bccb-dca7-4ad9-8c9d-d4671a05913b</serial>
Nov 30 10:07:09 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:07:09 user nova-compute[75340]: </disk>
Nov 30 10:07:09 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:09 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:07:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:16 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:19 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:07:20 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:07:21 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.089454650878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:07:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:07:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:07:24 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:07:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:07:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:07:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:07:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:29 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 is timed out.
Nov 30 10:07:29 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config.
Nov 30 10:07:29 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoAETmWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:07:29 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27fbdb6-333d-4724-8b4a-2f920dbc99fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:07:29 user nova-compute[75340]: No targets found.
Nov 30 10:07:29 user nova-compute[75340]: iSNS:
Nov 30 10:07:29 user nova-compute[75340]: No targets found.
Nov 30 10:07:29 user nova-compute[75340]: STATIC:
Nov 30 10:07:29 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b
Nov 30 10:07:29 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:07:29 user nova-compute[75340]:                 Iface Name: default
Nov 30 10:07:29 user nova-compute[75340]: FIRMWARE:
Nov 30 10:07:29 user nova-compute[75340]: No targets found.
Nov 30 10:07:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:07:29 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:07:29 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b44fa5-69b9-4e14-8cd2-7a62bd0bb8bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d73074-5365-43b1-a7e9-650ad8d52a9b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)
Nov 30 10:07:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b (non-flash)
Nov 30 10:07:29 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff5063f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:07:29 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85379ef-7b42-42e1-878a-d3f37146bc3d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df038bd-a1d5-4323-af04-2dd82b973610]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf10d5-7647-413c-82d9-31f7bcbb5455]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c254e-9eda-4e83-abeb-8a7af03065b8]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[210e5e6c-09f3-4406-8a96-082b7f3dde7b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390dd8d-dbc5-4dba-adcc-dc71a43ca3ac]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260]
Nov 30 10:07:30 user nova-compute[75340]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b, portal: 172.16.0.220,3260] successful.
Nov 30 10:07:30 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f85bccb-dca7-4ad9-8c9d-d4671a05913b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee2319-00f8-4a30-a774-d93c47284a85]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== disconnect_volume: return (316ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:31 user nova-compute[75340]: DEBUG nova.objects.instance [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:07:31 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-478daca3-f78e-4b89-856e-8a16d46bc599 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:07:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:07:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:07:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG nova.objects.instance [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:08:02 user nova-compute[75340]: INFO nova.compute.manager [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attaching volume 5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 to /dev/vdb
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.utils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa6137-d15f-4d27-9467-d1de0dfbb33e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc3e3ef-2fff-485f-944a-2bed1745e552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c947bd31-2903-411c-baa6-749be28606e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7106875-acd0-4477-acfe-1270470aacfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:08:02 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:08:02 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef93215-f293-4489-a750-afd68f1db29d]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG os_brick.utils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:08:02 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating existing volume attachment record: c9e69690-dc98-4d95-8ea2-80315b906d4c {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:08:04 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTCwxLYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:08:11 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:08:11 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:08:11 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1444cd-51a4-41e7-b461-bd54b4242b6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:08:11 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7151908e-57e5-4f8c-9ad2-09b29ed2457e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4] added
Nov 30 10:08:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa32178-a594-4deb-a10e-eb8317cb3bd6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b37bf34-20c7-48bc-9ceb-abd0b765d112]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTCwxLYy {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTCwxLYy" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7f2d8-97ca-4ba6-a7f9-1432e149f420]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTCwxLYy'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe7c83-9e77-4594-aae7-b2a678e83bf6]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c459d4fa-a500-43ac-9946-442176fce216]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:08:11 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:08:11 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:08:11 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:08:11 user nova-compute[75340]: 
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[5307c495-25dd-4818-9a5b-52e5a46a012b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260]
Nov 30 10:08:11 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260] successful.
Nov 30 10:08:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5d98a0-ea24-4391-8bcf-ffbeb9290620]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa97344-c565-41c4-a19c-3a0ce7bc820e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)
Nov 30 10:08:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)
Nov 30 10:08:11 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[725077af-e2f7-44ce-90cd-e9937785aa97]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:08:11 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTCwxLYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:08:12 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:08:12 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23264653861353264', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:08:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264653861353264', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:08:12 user nova-compute[75340]: DEBUG nova.objects.instance [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:08:12 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:08:12 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:08:12 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:08:12 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:08:12 user nova-compute[75340]:   <serial>5a6ea6b1-3d21-4644-99cc-7e3858c13ef4</serial>
Nov 30 10:08:12 user nova-compute[75340]: </disk>
Nov 30 10:08:12 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:08:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:08:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:08:13 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No VIF found with MAC fa:16:3e:41:51:05, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:08:13 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-73abe74a-e164-4f85-88b9-fda4dac266ab tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.508s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:08:14 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:08:15 user nova-compute[75340]: INFO nova.compute.manager [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Detaching volume 5a6ea6b1-3d21-4644-99cc-7e3858c13ef4
Nov 30 10:08:15 user nova-compute[75340]: INFO nova.virt.block_device [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attempting to driver detach volume 5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 from mountpoint /dev/vdb
Nov 30 10:08:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Attempting to detach device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:08:15 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:08:15 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:08:15 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:08:15 user nova-compute[75340]:   <serial>5a6ea6b1-3d21-4644-99cc-7e3858c13ef4</serial>
Nov 30 10:08:15 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:08:15 user nova-compute[75340]: </disk>
Nov 30 10:08:15 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:08:15 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config.
Nov 30 10:08:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:08:15 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:08:15 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:08:15 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:08:15 user nova-compute[75340]:   <serial>5a6ea6b1-3d21-4644-99cc-7e3858c13ef4</serial>
Nov 30 10:08:15 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:08:15 user nova-compute[75340]: </disk>
Nov 30 10:08:15 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:15 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:08:17 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:19 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:20 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:20 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:08:21 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:22 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:22 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:08:22 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:08:22 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.088485717773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:08:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:08:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:08:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:08:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:08:25 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:08:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:08:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:08:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:08:26 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:35 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 is timed out.
Nov 30 10:08:35 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config.
Nov 30 10:08:35 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTCwxLYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:08:35 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6ebd5-b1d1-47df-a814-c289efb95ee1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:08:35 user nova-compute[75340]: No targets found.
Nov 30 10:08:35 user nova-compute[75340]: iSNS:
Nov 30 10:08:35 user nova-compute[75340]: No targets found.
Nov 30 10:08:35 user nova-compute[75340]: STATIC:
Nov 30 10:08:35 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4
Nov 30 10:08:35 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:08:35 user nova-compute[75340]:                 Iface Name: default
Nov 30 10:08:35 user nova-compute[75340]: FIRMWARE:
Nov 30 10:08:35 user nova-compute[75340]: No targets found.
Nov 30 10:08:35 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:08:35 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:08:35 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f88108-fbed-4eb5-9f61-b179b7bbe769]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1e7c0-2c48-41c1-8579-d46e7393907f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)
Nov 30 10:08:35 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 (non-flash)
Nov 30 10:08:35 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff502be830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d62574b-01be-4c24-9cb6-948f09e81f2c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b336dd5-163c-4c84-ba4d-f81c25a73fc6]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ae299-2047-4bc6-b457-46c32703cc4a]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9118f25-4eb3-48ca-8ae2-fe660602f512]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ee3456-053d-48fd-bade-9e2b0954fd29]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:35 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac018461-6d9e-4f59-bb1b-ad41ea4b5842]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260]
Nov 30 10:08:36 user nova-compute[75340]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4, portal: 172.16.0.220,3260] successful.
Nov 30 10:08:36 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6ea6b1-3d21-4644-99cc-7e3858c13ef4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75f671-3afd-4534-80ee-954464d6b81d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== disconnect_volume: return (288ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:08:36 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:08:37 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:08:37 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5c0e5eae-cbd4-4034-a2c3-47e5232b57c0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.897s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:08:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:42 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:08:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:09:08 user nova-compute[75340]: INFO nova.compute.manager [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attaching volume aff25bfa-9766-43cf-b5cc-e88f66373941 to /dev/vdb
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.utils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f34ace-ce7e-4700-b349-b8ee1322f7e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d96c2dd5dbe2\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1116830-bec6-41a2-8322-f82aa2183487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[18132337-b869-4207-b397-1ef910b1c1b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f684dfb4-55cc-4120-b20c-95f68e9904b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Running cmd (subprocess): nvme version {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] 'nvme version' failed. Not Retrying. {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] nvme not present on system {{(pid=75340) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:09:08 user nova-compute[75340]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:09:08 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[339bd75f-8eb2-4b03-a268-84e0877d7046]: (4, '') {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75340) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.lightos [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] LIGHTOS: no hostnqn found. {{(pid=75340) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG os_brick.utils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d96c2dd5dbe2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:09:08 user nova-compute[75340]: DEBUG nova.virt.block_device [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating existing volume attachment record: e5f64154-f1d9-40ae-9c70-154669ed8fed {{(pid=75340) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:09:09 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Calling os-brick to attach iSCSI Volume {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQEdmZtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:09:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:09:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:09:17 user nova-compute[75340]: INFO os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52462dc-f234-4784-be90-0bc619378461]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:09:17 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --interface default --op new {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[982da24c-74e9-4b39-a606-be9057973663]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941] added\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941] added
Nov 30 10:09:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b754220-8865-465d-b150-794b525970ae]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60a524e-9821-41e0-ac27-2d0023344f7c]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQEdmZtp {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQEdmZtp" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05a2cd-ab43-405b-9a6e-b2567cf03c0b]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JQEdmZtp'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee00aa-1fbb-497b-a32e-2ee36abe9f54]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[15983dba-6948-41a9-bccf-372fc0570a50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:09:17 user nova-compute[75340]:  {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:09:17 user nova-compute[75340]:  {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:09:17 user nova-compute[75340]: WARNING os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:09:17 user nova-compute[75340]: 
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --login {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a08737-b24d-45db-8d4d-beddb63e5849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260]
Nov 30 10:09:17 user nova-compute[75340]: Login to [iface: default, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260] successful.
Nov 30 10:09:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3617b52-e658-4484-8bfe-6b8e55b5c349]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98d8e6-c352-444b-b343-ef137b035fb4]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)
Nov 30 10:09:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)
Nov 30 10:09:17 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to 172.16.0.220:3260 {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75340) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75340) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b600c7-d14d-44d7-9c7e-e2d302023d41]: (4, ('- - 0', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:17 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75340) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQEdmZtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75340) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26462383862333536', 'path': '/dev/sdb'} {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462383862333536', 'path': '/dev/sdb'} {{(pid=75340) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG nova.objects.instance [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:09:18 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:09:18 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:09:18 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:09:18 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:09:18 user nova-compute[75340]:   <serial>aff25bfa-9766-43cf-b5cc-e88f66373941</serial>
Nov 30 10:09:18 user nova-compute[75340]: </disk>
Nov 30 10:09:18 user nova-compute[75340]:  {{(pid=75340) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:09:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vda, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:09:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75340) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:09:19 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] No VIF found with MAC fa:16:3e:41:51:05, not building metadata {{(pid=75340) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:09:19 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-f1ecd257-1abb-4018-9811-fe1198e64ac0 tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.690s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:09:19 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:09:22 user nova-compute[75340]: INFO nova.compute.manager [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Detaching volume aff25bfa-9766-43cf-b5cc-e88f66373941
Nov 30 10:09:22 user nova-compute[75340]: INFO nova.virt.block_device [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Attempting to driver detach volume aff25bfa-9766-43cf-b5cc-e88f66373941 from mountpoint /dev/vdb
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Attempting to detach device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config. {{(pid=75340) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:09:22 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:09:22 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:09:22 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:09:22 user nova-compute[75340]:   <serial>aff25bfa-9766-43cf-b5cc-e88f66373941</serial>
Nov 30 10:09:22 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:09:22 user nova-compute[75340]: </disk>
Nov 30 10:09:22 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:09:22 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the persistent domain config.
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config. {{(pid=75340) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.guest [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:09:22 user nova-compute[75340]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:09:22 user nova-compute[75340]:   <source dev="/dev/sdb"/>
Nov 30 10:09:22 user nova-compute[75340]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:09:22 user nova-compute[75340]:   <serial>aff25bfa-9766-43cf-b5cc-e88f66373941</serial>
Nov 30 10:09:22 user nova-compute[75340]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:09:22 user nova-compute[75340]: </disk>
Nov 30 10:09:22 user nova-compute[75340]:  {{(pid=75340) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:22 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:09:23 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:24 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:09:24 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.079689025878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:09:24 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:09:26 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:09:27 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:09:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:09:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:09:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:28 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:09:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:42 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 is timed out.
Nov 30 10:09:42 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully detached device vdb from instance f5ca1485-9214-46ee-b776-f1fee2b728f6 from the live domain config.
Nov 30 10:09:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] calling os-brick to detach iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7eff501b13f0>, {'target_iqn': 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQEdmZtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:09:42 user nova-compute[75340]: WARNING os_brick.initiator.connectors.base [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fbd2a1-4fd8-4380-857e-10e5a766d74c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:09:42 user nova-compute[75340]: No targets found.
Nov 30 10:09:42 user nova-compute[75340]: iSNS:
Nov 30 10:09:42 user nova-compute[75340]: No targets found.
Nov 30 10:09:42 user nova-compute[75340]: STATIC:
Nov 30 10:09:42 user nova-compute[75340]: Target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941
Nov 30 10:09:42 user nova-compute[75340]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:09:42 user nova-compute[75340]:                 Iface Name: default
Nov 30 10:09:42 user nova-compute[75340]: FIRMWARE:
Nov 30 10:09:42 user nova-compute[75340]: No targets found.
Nov 30 10:09:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:09:42 user nova-compute[75340]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:09:42 user nova-compute[75340]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75340) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941', 0)] {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a142bcf-62ee-40aa-9459-817355e643bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a5b42-f4ad-4ffc-8902-c34d280a5a36]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)
Nov 30 10:09:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 (non-flash)
Nov 30 10:09:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7eff50fa4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941'): ({'sdb'}, set())}) {{(pid=75340) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Removing single pathed devices sdb {{(pid=75340) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b08263e-3b2c-4d45-8675-6b2135df6202]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd44642-07fc-4929-a912-28b00a900ee5]: (4, ('ok\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Flushing IO for device /dev/sdb {{(pid=75340) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bcacb6-618d-44f8-ba28-42cafac5299f]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75340) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83851ca-fc90-4f05-acbf-b4fb82eaac0d]: (4, ('1', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.linuxscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] SCSI volumes sdb have been removed. {{(pid=75340) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941')] {{(pid=75340) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647f612-b3bf-4361-9ad1-5f0ada08096d]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --logout {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b277f77-5014-4340-9cf6-75b7240e44c2]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260]
Nov 30 10:09:42 user nova-compute[75340]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941, portal: 172.16.0.220,3260] successful.
Nov 30 10:09:42 user nova-compute[75340]:  stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op delete {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff25bfa-9766-43cf-b5cc-e88f66373941 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6dc14-2226-43b7-9720-2e23e2309bbd]: (4, ('', '')) {{(pid=86898) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75340) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.base [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] <== disconnect_volume: return (337ms) None {{(pid=75340) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:09:42 user nova-compute[75340]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Disconnected iSCSI Volume {{(pid=75340) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:09:43 user nova-compute[75340]: DEBUG nova.objects.instance [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'flavor' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:09:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-c8ef8fb8-1ff7-4008-9aaa-434320dfbafb tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:45 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:50 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:09:55 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:00 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:05 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:10 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:15 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:20 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:10:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:10:25 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquired lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Forcefully refreshing network info cache for instance {{(pid=75340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG nova.objects.instance [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lazy-loading 'info_cache' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG nova.network.neutron [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [{"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Releasing lock "refresh_cache-f5ca1485-9214-46ee-b776-f1fee2b728f6" {{(pid=75340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updated the network info_cache for instance {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:10:26 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG oslo_concurrency.processutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75340) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:10:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:10:27 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=25.078800201416016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Instance f5ca1485-9214-46ee-b776-f1fee2b728f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75340) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing inventories for resource provider 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating ProviderTree inventory for provider 0b79bb92-a015-438b-9e5d-504678a00853 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Updating inventory in ProviderTree for provider 0b79bb92-a015-438b-9e5d-504678a00853 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing aggregate associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, aggregates: None {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Refreshing trait associations for resource provider 0b79bb92-a015-438b-9e5d-504678a00853, traits: HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75340) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:10:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:30 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:10:35 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:43 user nova-compute[75340]: INFO nova.compute.manager [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Terminating instance
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.compute.manager [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Start destroying the instance on the hypervisor. {{(pid=75340) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-unplugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] No waiting events found dispatching network-vif-unplugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.compute.manager [req-f6c33036-55d2-46c3-adaf-9d8a7f815a63 req-ac49d40f-fcb6-46da-bdef-bdced9824de6 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-unplugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d for instance with task_state deleting. {{(pid=75340) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Instance destroyed successfully.
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.objects.instance [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lazy-loading 'resources' on Instance uuid f5ca1485-9214-46ee-b776-f1fee2b728f6 {{(pid=75340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.virt.libvirt.vif [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081540024',display_name='tempest-SnapshotDataIntegrityTests-server-1081540024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081540024',id=53,image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETA0uRT0Xd/2oD614ldfOsTTnpKiVp9+nmsviyso9Xqn1WeBTOH8vMaxtUQGLmXHx0KKTQE3OI/kMLiHlP1CS/eTGbEb9wDnV/yYGR4uLhe9jmPZ8yUSLT8LqSkI8AKVw==',key_name='tempest-keypair-166272535',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:03:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c59630e585433d8e7c92c7da4ed03d',ramdisk_id='',reservation_id='r-vpt59h9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a858ddd5-7e49-4452-af44-f170b5cc722b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-770682453',owner_user_name='tempest-SnapshotDataIntegrityTests-770682453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9304bd90ce6c4d8a90f07eda21e3565a',uuid=f5ca1485-9214-46ee-b776-f1fee2b728f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converting VIF {"id": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "address": "fa:16:3e:41:51:05", "network": {"id": "a2e013c3-a140-46e0-baf5-70e88c717422", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-64373761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c59630e585433d8e7c92c7da4ed03d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0a7ef0-f2", "ovs_interfaceid": "db0a7ef0-f252-4b32-b942-f46ab0df2c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.network.os_vif_util [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2') {{(pid=75340) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG os_vif [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2') {{(pid=75340) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb0a7ef0-f2, bridge=br-int, if_exists=True) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c703414a-14db-4e83-9883-f0dc9e881bca) {{(pid=75340) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:43 user nova-compute[75340]: INFO os_vif [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:51:05,bridge_name='br-int',has_traffic_filtering=True,id=db0a7ef0-f252-4b32-b942-f46ab0df2c3d,network=Network(a2e013c3-a140-46e0-baf5-70e88c717422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0a7ef0-f2')
Nov 30 10:10:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Deleting instance files /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6_del
Nov 30 10:10:43 user nova-compute[75340]: INFO nova.virt.libvirt.driver [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Deletion of /opt/stack/data/nova/instances/f5ca1485-9214-46ee-b776-f1fee2b728f6_del complete
Nov 30 10:10:43 user nova-compute[75340]: INFO nova.compute.manager [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 10:10:43 user nova-compute[75340]: DEBUG oslo.service.loopingcall [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75340) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.compute.manager [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Deallocating network for instance {{(pid=75340) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:10:43 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] deallocate_for_instance() {{(pid=75340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG nova.network.neutron [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Updating instance_info_cache with network_info: [] {{(pid=75340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:10:44 user nova-compute[75340]: INFO nova.compute.manager [-] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Took 0.78 seconds to deallocate network for instance.
Nov 30 10:10:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG nova.compute.manager [req-e02d724a-4000-4262-a364-ef39336fa138 req-b16be412-7b65-42e8-8b16-cef11da78e94 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-deleted-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:44 user nova-compute[75340]: INFO nova.scheduler.client.report [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Deleted allocations for instance f5ca1485-9214-46ee-b776-f1fee2b728f6
Nov 30 10:10:44 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-5f30721d-950b-48a8-931e-fe61bc7d2dad tempest-SnapshotDataIntegrityTests-770682453 tempest-SnapshotDataIntegrityTests-770682453-project-member] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:10:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] Acquiring lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:10:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:10:45 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] Lock "f5ca1485-9214-46ee-b776-f1fee2b728f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:10:45 user nova-compute[75340]: DEBUG nova.compute.manager [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] No waiting events found dispatching network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d {{(pid=75340) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:10:45 user nova-compute[75340]: WARNING nova.compute.manager [req-6df41ca6-b233-46aa-996b-f86cc8c58674 req-adfb7f66-8fa4-4b91-9cd4-67342cfe4214 service nova] [instance: f5ca1485-9214-46ee-b776-f1fee2b728f6] Received unexpected event network-vif-plugged-db0a7ef0-f252-4b32-b942-f46ab0df2c3d for instance with vm_state deleted and task_state None.
Nov 30 10:10:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:10:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:10:59 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:10:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:10:59 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] There are 0 instances to clean {{(pid=75340) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:11:02 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:02 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75340) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:11:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:11:08 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:13 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:11:18 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:11:21 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75340) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75340) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75340) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:11:23 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:24 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:25 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Starting heal instance info cache {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Rebuilding the list of instances to heal {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG nova.compute.manager [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Didn't find any instances for network info cache update. {{(pid=75340) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:11:27 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Auditing locally available compute resources for user (node: user) {{(pid=75340) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:11:28 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:11:28 user nova-compute[75340]: WARNING nova.virt.libvirt.driver [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Hypervisor/Node resource view: name=user free_ram=9156MB free_disk=25.10614013671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75340) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75340) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.compute.provider_tree [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed in ProviderTree for provider: 0b79bb92-a015-438b-9e5d-504678a00853 {{(pid=75340) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.scheduler.client.report [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Inventory has not changed for provider 0b79bb92-a015-438b-9e5d-504678a00853 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75340) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG nova.compute.resource_tracker [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Compute_service record updated for user:user {{(pid=75340) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG oslo_concurrency.lockutils [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75340) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:11:28 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:31 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:33 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:33 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:36 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:38 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:40 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:43 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:48 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:11:49 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:11:53 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:11:58 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:12:03 user nova-compute[75340]: DEBUG oslo_service.periodic_task [None req-4dc726fc-72fb-44db-9451-895aeac76f17 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75340) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:12:03 user nova-compute[75340]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75340) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}